[ 510.431943] env[70287]: INFO neutron.common.config [-] Logging enabled! [ 510.432305] env[70287]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 0.0.1.dev16 [ 510.432415] env[70287]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=70287) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 510.432709] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 510.432808] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 510.433637] env[70287]: WARNING oslo_policy.policy [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 510.433857] env[70287]: WARNING oslo_policy.policy [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 510.435330] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] VMware NSXv3 Agent initialized successfully. [ 510.435691] env[70287]: DEBUG oslo_concurrency.lockutils [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] Acquiring lock "singleton_lock" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.435818] env[70287]: DEBUG oslo_concurrency.lockutils [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] Acquired lock "singleton_lock" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.436039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] Releasing lock "singleton_lock" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.436330] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] Full set of CONF: {{(pid=70287) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/eventlet/service.py:357}} [ 510.436534] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ******************************************************************************** {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 510.436732] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] Configuration options gathered from: {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 510.436890] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 510.437077] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 510.437193] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ================================================================================ {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 510.437368] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] agent_down_time = 75 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.437518] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] allow_automatic_dhcp_failover = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.437666] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] allow_bulk = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.437821] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] api_extensions_path = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.437963] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] api_paste_config = api-paste.ini {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.438122] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] auth_strategy = keystone {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.438234] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] backdoor_port = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.438344] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] backdoor_socket = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.438486] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] backlog = 4096 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.438629] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] base_mac = fa:16:3e:00:00:00 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.438792] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] bind_host = 0.0.0.0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.438940] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] bind_port = 9696 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.439090] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] client_socket_timeout = 900 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.439232] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] config_dir = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.439375] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.439488] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] config_source = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.439635] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] control_exchange = neutron {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.439779] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] core_plugin = ml2 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.439922] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] debug = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.440229] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] default_availability_zones = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.440312] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.440423] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] dhcp_agent_notification = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.440566] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] dhcp_agents_per_network = 1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.440712] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] dhcp_lease_duration = 86400 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.440866] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] dhcp_load_type = networks {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441030] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] dns_domain = openstacklocal {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441158] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441299] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] enable_default_route_bfd = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441436] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] enable_default_route_ecmp = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441572] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] enable_dvr = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441708] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] enable_new_agents = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441842] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.441977] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] enable_signals = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.442125] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] enable_traditional_dhcp = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.442260] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] external_dns_driver = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.442394] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] filter_validation = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.442541] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] global_physnet_mtu = 8950 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.442798] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] graceful_shutdown_timeout = 60 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.442886] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] host = cpu-1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.443008] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] host_dvr_for_dhcp = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.443154] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] http_retries = 3 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.443298] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] instance_format = [instance: %(uuid)s] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.443439] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.443582] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ipam_driver = internal {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.443719] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ipv6_pd_enabled = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.443857] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] l3_ha = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444006] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444154] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] l3_ha_network_physical_name = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444294] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] l3_ha_network_type = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444440] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_color = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444719] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_config_append = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444719] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444848] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_dir = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.444981] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_file = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.445110] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_options = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.445254] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_rotate_interval = 1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.445496] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_rotate_interval_type = days {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.445553] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] log_rotation_type = none {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.445650] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.445758] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.445901] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446055] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446163] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446302] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] max_dns_nameservers = 5 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446439] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] max_header_line = 16384 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446577] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] max_l3_agents_per_router = 3 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446726] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] max_logfile_count = 30 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446847] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] max_logfile_size_mb = 200 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.446986] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] max_subnet_host_routes = 20 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.447288] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] my_ip = 10.180.1.21 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.447288] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] my_ipv6 = ::1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.447404] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] network_auto_schedule = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.447536] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] network_link_prefix = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.447679] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.447824] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] notify_nova_on_port_data_changes = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.447968] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] notify_nova_on_port_status_changes = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.448116] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] pagination_max_limit = -1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.448267] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] publish_errors = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.448385] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] rate_limit_burst = 0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.448527] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] rate_limit_except_level = CRITICAL {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.448982] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] rate_limit_interval = 0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.448982] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] retry_until_window = 30 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.448982] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] router_distributed = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.449170] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] rpc_resources_processing_step = 20 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.449200] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] rpc_response_max_timeout = 600 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.449355] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] rpc_response_timeout = 60 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.449474] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] send_events_interval = 2 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.449628] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] service_plugins = ['router'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.449775] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] setproctitle = on {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.449909] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] shell_completion = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.450060] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] state_path = /opt/stack/data/neutron {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.450205] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] syslog_log_facility = LOG_USER {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.450343] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] tcp_keepidle = 600 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.450483] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] transport_url = **** {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.450620] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] use_journal = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.450759] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] use_json = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.450936] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] use_ssl = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451032] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] use_stderr = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451175] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] use_syslog = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451335] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] vlan_qinq = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451444] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] vlan_transparent = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451581] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] watch_log_file = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451719] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] wsgi_default_pool_size = 100 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451853] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] wsgi_keep_alive = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.451995] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.452144] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] wsgi_server_debug = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 510.452417] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_concurrency.disable_process_locking = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.452486] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.452584] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.452724] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.452870] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.453020] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.453202] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.453321] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.connection_string = messaging:// {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.453465] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.enabled = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.453617] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.es_doc_type = notification {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.453759] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.es_scroll_size = 10000 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.453905] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.es_scroll_time = 2m {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.454055] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.filter_error_trace = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.454203] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.hmac_keys = **** {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.454346] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.sentinel_service_name = mymaster {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.454582] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.socket_timeout = 0.1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.454661] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.trace_requests = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.454760] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler.trace_sqlalchemy = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.454915] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler_jaeger.process_tags = {} {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.455065] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler_jaeger.service_name_prefix = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.455206] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] profiler_otlp.service_name_prefix = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.455361] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.enforce_new_defaults = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.455642] env[70287]: WARNING oslo_config.cfg [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 510.455877] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.enforce_scope = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.455950] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.policy_default_rule = default {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.456115] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.456268] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.456413] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.456552] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.456686] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.456817] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.456955] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.457182] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.457254] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.457406] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] agent.extensions = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.457552] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.457698] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] service_providers.service_provider = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.457847] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.default_quota = -1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.457998] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.458152] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_floatingip = 50 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.458288] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_network = 100 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.458497] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_port = 500 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.458562] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.458699] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_router = 10 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.458841] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_security_group = 10 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.458978] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.459128] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.quota_subnet = 100 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.459266] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] QUOTAS.track_quota_usage = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.459419] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.459558] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep.group = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.459789] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep.helper_command = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.459847] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.459964] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep.thread_pool_size = 8 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.460112] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep.user = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.460264] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.460402] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_dhcp_release.group = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.460537] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_dhcp_release.helper_command = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.460694] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.460828] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.460963] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_dhcp_release.user = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.461120] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.461256] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_ovs_vsctl.group = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.461390] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_ovs_vsctl.helper_command = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.461531] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.461677] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.461810] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_ovs_vsctl.user = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.461953] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_namespace.capabilities = [21] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.462100] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_namespace.group = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.462238] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_namespace.helper_command = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.462379] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.462522] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_namespace.thread_pool_size = 8 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.462661] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_namespace.user = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.462810] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_conntrack.capabilities = [12] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.462953] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_conntrack.group = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.463091] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_conntrack.helper_command = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.463235] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.463375] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.463507] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_conntrack.user = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.463653] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_link.capabilities = [12, 21] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.463789] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_link.group = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.463923] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_link.helper_command = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.464073] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.464217] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_link.thread_pool_size = 8 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.464350] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] privsep_link.user = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.464505] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.464853] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.464853] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.continue_on_failed_promotions = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.464996] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.dscp = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.465061] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.dscp_inherit = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.465213] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.force_mp_to_policy = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.465352] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.locking_coordinator_url = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.465490] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.log_agent_heartbeats = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.465631] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.logging_expire = 1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.465777] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.465917] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.466074] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.polling_interval = 240 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.466218] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.466365] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.466509] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.report_interval = 30.0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.466656] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.466800] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.466947] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.467099] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.sync_skew = 60 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.467241] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.synchronization_queue_size = 20 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.467383] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT.use_helper_for_ns_read = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.467530] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] SECURITYGROUP.enable_ipset = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.467678] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] SECURITYGROUP.enable_security_group = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.467834] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.467966] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.468124] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] experimental.ipv6_pd_enabled = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.468284] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.extension_drivers = ['port_security'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.468424] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.external_network_type = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.468572] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.468720] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.overlay_ip_version = 4 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.468869] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.path_mtu = 8950 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.469021] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.physical_network_mtus = {} {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.469182] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.tenant_network_types = ['vlan'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.469333] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.469480] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ml2.type_drivers = ['vlan'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.469625] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT_CLI.neutron_port_id = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.469766] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.469927] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.470060] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.470230] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.470358] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.470500] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.470632] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.470779] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.470977] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.471143] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_login_password = **** {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.471296] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_login_port = 443 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.471442] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_login_user = admin {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.471590] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.471741] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.471885] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.472036] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.472188] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.472338] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.472487] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.472636] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.472778] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.472925] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.473094] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.473406] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.473406] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.473571] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.473719] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] vsphere.vsphere_login_password = VMware1! {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.473906] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.474030] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.474159] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.auth_section = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.474310] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.auth_type = password {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.474455] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.474593] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.certfile = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.474732] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.collect_timing = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.474880] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.endpoint_type = public {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.475029] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.insecure = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.475170] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.keyfile = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.475319] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.region_name = RegionOne {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.475459] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.split_loggers = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.475599] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] nova.timeout = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.475745] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.auth_section = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.475896] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.auth_type = password {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.476051] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.476194] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.certfile = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.476335] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.collect_timing = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.476482] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.endpoint_type = public {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.476620] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.insecure = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.476758] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.keyfile = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.476898] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.region_name = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.477049] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.split_loggers = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.477192] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] placement.timeout = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.477340] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.auth_section = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.auth_type = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.cafile = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.certfile = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.collect_timing = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.connect_retries = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.connect_retry_delay = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.enable_notifications = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481315] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.endpoint_override = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481315] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.insecure = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481315] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.interface = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481315] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.keyfile = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481315] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.max_version = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481315] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.min_version = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481315] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.region_name = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481491] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.retriable_status_codes = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481491] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.service_name = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481491] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.service_type = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481491] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.split_loggers = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481491] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.status_code_retries = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481491] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.status_code_retry_delay = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481491] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.timeout = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481692] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.valid_interfaces = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481692] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ironic.version = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481692] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] cli_script.dry_run = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481692] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481692] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481692] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481692] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481869] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481869] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481869] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481869] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481869] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.481869] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482042] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482427] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482427] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482427] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482594] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482717] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482854] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.482990] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.483142] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.483278] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.483414] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.483553] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.483693] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486465] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486465] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486465] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486465] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486465] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486465] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486858] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486858] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.ssl = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486858] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486858] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486858] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486858] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.486858] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.487528] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.487528] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_notifications.driver = [] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.487528] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_notifications.retry = -1 {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.487528] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.487528] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 510.487528] env[70287]: DEBUG oslo_service.backend.eventlet.service [None req-6b8479c8-def6-4296-9add-e195980ca3b3 None None] ******************************************************************************** {{(pid=70287) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 510.487746] env[70287]: DEBUG neutron.agent.securitygroups_rpc [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Init firewall settings (driver=nsxv3) {{(pid=70287) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 510.488580] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=70287) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 510.488824] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] RPC agent_id: nsxm-l-01a.corp.local [ 510.491062] env[70287]: DEBUG dogpile.cache.region [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 510.491187] env[70287]: DEBUG dogpile.lock [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 510.491287] env[70287]: DEBUG dogpile.lock [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 510.491381] env[70287]: DEBUG dogpile.lock [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 510.491477] env[70287]: DEBUG dogpile.cache.region [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 510.491566] env[70287]: DEBUG dogpile.lock [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 510.491698] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 510.511472] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Session token - acquiring [ 510.512954] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.513138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.513235] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.513641] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.524246] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 510.811802] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 510.836380] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 510.836520] env[70287]: DEBUG dogpile.cache.region [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Cache value generated in 0.345 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 510.836636] env[70287]: DEBUG dogpile.lock [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 510.836754] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Activating Policy API Provider. [ 510.836956] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Looking for the default Infrastructure Rules. [ 510.922148] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Looking for the Default Layer3 Logged Drop Section. [ 510.935473] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 510.937748] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 510.937748] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 510.937748] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 510.937936] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 510.938222] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 511.452883] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 511.954925] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 512.456823] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Inventory metadata is going to be refreshed. [ 512.457185] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 513.290415] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.290734] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.290895] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 513.291283] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 513.304812] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 513.415287] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.416378] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 513.433196] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.433530] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.433530] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 513.433750] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 513.433877] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.434081] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 513.434211] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.434324] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 513.457231] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.457657] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.457657] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 513.457811] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 513.457984] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.458147] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 513.477263] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.477461] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.477526] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 513.477758] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 513.477896] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.478050] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 513.494412] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.494599] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.494673] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 513.494903] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 513.495047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.495193] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 513.495304] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.495409] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 513.512140] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.512431] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.512431] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 513.512633] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 513.512752] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.512886] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 513.512995] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.513122] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 513.532174] env[70287]: DEBUG networking_nsxv3.common.locking [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 513.532351] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 513.532514] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 513.532656] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 513.532786] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.532927] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 513.533045] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 513.533173] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Inventory metadata have been refreshed. [ 513.533245] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Dryrun:True. Metadata refresh completed. [ 513.533360] env[70287]: DEBUG oslo_concurrency.lockutils [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Releasing lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 513.534969] env[70287]: INFO neutron.agent.agent_extensions_manager [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Loaded agent extensions: [] [ 513.535679] env[70287]: DEBUG neutron_lib.callbacks.manager [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=70287) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 513.595664] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent RPC Daemon Started! [ 513.595815] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent loop - iteration:0 started [ 513.595920] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent out of sync with plugin! [ 518.536680] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 518.537087] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 523.538213] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 523.538487] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 527.265811] env[70287]: INFO networking_nsxv3.common.synchronization [None req-04f20e61-cffc-459f-beae-a4c743a7f479 demo admin] Enqueued Resource ID: 32db9abd-877c-4b93-bd51-a8de41cdcb38 with Priority: HIGHEST for action security_group_rules [ 527.265811] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32db9abd-877c-4b93-bd51-a8de41cdcb38 with Priority: HIGHEST for action security_group_rules [ 527.266091] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32db9abd-877c-4b93-bd51-a8de41cdcb38 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.266222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32db9abd-877c-4b93-bd51-a8de41cdcb38" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.266260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32db9abd-877c-4b93-bd51-a8de41cdcb38" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.266597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32db9abd-877c-4b93-bd51-a8de41cdcb38" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.266681] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32db9abd-877c-4b93-bd51-a8de41cdcb38',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.789092] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.789279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.789279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.789463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.789557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.789652] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32db9abd-877c-4b93-bd51-a8de41cdcb38 already deleted. [ 527.789734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32db9abd-877c-4b93-bd51-a8de41cdcb38" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 532.266620] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 532.266989] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 537.268541] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 537.268541] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 542.269998] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 542.269998] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.270560] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 547.270560] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 547.540561] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.540561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.540561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.540561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.540561] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.046460] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.548723] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.058071] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 549.058071] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 549.800572] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.800968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.800968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.801097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.817594] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 549.820524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.821636] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 549.841974] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.842172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.842254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.842392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.842476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.842586] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 549.842657] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.842727] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 549.864215] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.864362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.864432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.864816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.864816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.865091] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 549.882685] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.882876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.882934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.883116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.883235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.883347] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 549.901572] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.901824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.901824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.901974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.902085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.903078] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 549.903078] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.903078] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 549.919130] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.919296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.919365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.919566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.919647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.919753] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 549.919822] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.919890] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 549.938099] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.938254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.938306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.938512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.938608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.938723] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 549.938793] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 549.938884] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 549.938918] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 549.938989] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 549.939061] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 549.939146] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 549.939461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 549.939525] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 549.939585] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 549.967133] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.967289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.967360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.967566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.967674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 549.967787] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 549.986628] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 549.986764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 549.986828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 549.987040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 549.987138] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.018850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 551.584970] env[70287]: INFO networking_nsxv3.common.synchronization [None req-4d56c4e2-1030-4de0-bad5-866f526b586b None None] Enqueued Resource ID: afac9fac-a4ff-4c91-b962-f674cf4bcbab with Priority: HIGHEST for action port [ 551.588440] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afac9fac-a4ff-4c91-b962-f674cf4bcbab with Priority: HIGHEST for action port [ 551.588440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-afac9fac-a4ff-4c91-b962-f674cf4bcbab taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 551.588440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-afac9fac-a4ff-4c91-b962-f674cf4bcbab" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 551.588440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-afac9fac-a4ff-4c91-b962-f674cf4bcbab" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 551.588440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-afac9fac-a4ff-4c91-b962-f674cf4bcbab" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 551.588440] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('afac9fac-a4ff-4c91-b962-f674cf4bcbab',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 552.091268] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port afac9fac-a4ff-4c91-b962-f674cf4bcbab [ 552.091512] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.091647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.091711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.091919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.092015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 552.092119] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:afac9fac-a4ff-4c91-b962-f674cf4bcbab already deleted. [ 552.092236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-afac9fac-a4ff-4c91-b962-f674cf4bcbab" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.439187] env[70287]: INFO networking_nsxv3.common.synchronization [None req-1d42a163-c52a-4789-958a-500070bcb69f None None] Enqueued Resource ID: 686d83b6-aaab-4890-9291-451f82cc4e62 with Priority: HIGHEST for action port [ 553.439187] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686d83b6-aaab-4890-9291-451f82cc4e62 with Priority: HIGHEST for action port [ 553.439187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-686d83b6-aaab-4890-9291-451f82cc4e62 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.439187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-686d83b6-aaab-4890-9291-451f82cc4e62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.439187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-686d83b6-aaab-4890-9291-451f82cc4e62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.439187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-686d83b6-aaab-4890-9291-451f82cc4e62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.439187] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('686d83b6-aaab-4890-9291-451f82cc4e62',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.942378] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 686d83b6-aaab-4890-9291-451f82cc4e62 [ 553.943397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.943397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.943397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.943397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.943397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.943397] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:686d83b6-aaab-4890-9291-451f82cc4e62 already deleted. [ 553.943397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-686d83b6-aaab-4890-9291-451f82cc4e62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.101640] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7e92db15-e4a1-4f33-af2a-247a911c5f12 None None] Enqueued Resource ID: e115508e-0cc3-4f73-a71c-f628ed618258 with Priority: HIGHEST for action port [ 556.101640] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e115508e-0cc3-4f73-a71c-f628ed618258 with Priority: HIGHEST for action port [ 556.102744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e115508e-0cc3-4f73-a71c-f628ed618258 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.102744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e115508e-0cc3-4f73-a71c-f628ed618258" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.102744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e115508e-0cc3-4f73-a71c-f628ed618258" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.102873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e115508e-0cc3-4f73-a71c-f628ed618258" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.102942] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e115508e-0cc3-4f73-a71c-f628ed618258',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 556.609022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e115508e-0cc3-4f73-a71c-f628ed618258 [ 556.609022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 556.609915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 556.610080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 556.610305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 556.610399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 556.610530] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e115508e-0cc3-4f73-a71c-f628ed618258 already deleted. [ 556.610584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e115508e-0cc3-4f73-a71c-f628ed618258" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.255057] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ca114ec8-a996-4948-8dc8-cde5256ec26e None None] Enqueued Resource ID: f6cd0392-57ec-44e1-9d05-5bb18652c18a with Priority: HIGHEST for action port [ 557.255057] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6cd0392-57ec-44e1-9d05-5bb18652c18a with Priority: HIGHEST for action port [ 557.255057] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6cd0392-57ec-44e1-9d05-5bb18652c18a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.255057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6cd0392-57ec-44e1-9d05-5bb18652c18a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.255057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6cd0392-57ec-44e1-9d05-5bb18652c18a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.255057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6cd0392-57ec-44e1-9d05-5bb18652c18a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.255057] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6cd0392-57ec-44e1-9d05-5bb18652c18a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 557.757954] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6cd0392-57ec-44e1-9d05-5bb18652c18a [ 557.758263] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.758542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.758542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.758702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.758765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.758866] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6cd0392-57ec-44e1-9d05-5bb18652c18a already deleted. [ 557.758946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6cd0392-57ec-44e1-9d05-5bb18652c18a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 557.918992] env[70287]: INFO networking_nsxv3.common.synchronization [None req-bd887dbf-b2b5-4f53-8b8f-0f528183ea35 None None] Enqueued Resource ID: 73e36854-8a74-48bd-b25c-39e38a4c8b69 with Priority: HIGHEST for action port [ 557.918992] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73e36854-8a74-48bd-b25c-39e38a4c8b69 with Priority: HIGHEST for action port [ 557.918992] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-73e36854-8a74-48bd-b25c-39e38a4c8b69 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 557.918992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73e36854-8a74-48bd-b25c-39e38a4c8b69" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 557.918992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73e36854-8a74-48bd-b25c-39e38a4c8b69" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 557.920413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73e36854-8a74-48bd-b25c-39e38a4c8b69" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 557.920604] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73e36854-8a74-48bd-b25c-39e38a4c8b69',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 558.423708] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73e36854-8a74-48bd-b25c-39e38a4c8b69 [ 558.423991] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.424097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.424170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.424429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.424530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.424630] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73e36854-8a74-48bd-b25c-39e38a4c8b69 already deleted. [ 558.424765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73e36854-8a74-48bd-b25c-39e38a4c8b69" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.828871] env[70287]: INFO networking_nsxv3.common.synchronization [None req-97e0b3f2-02ed-4d05-b01b-97d17466d128 None None] Enqueued Resource ID: d51d0f82-dd6f-4833-b528-562e9b8e5205 with Priority: HIGHEST for action port [ 558.829306] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d51d0f82-dd6f-4833-b528-562e9b8e5205 with Priority: HIGHEST for action port [ 558.829915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d51d0f82-dd6f-4833-b528-562e9b8e5205 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 558.832028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d51d0f82-dd6f-4833-b528-562e9b8e5205" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 558.832028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d51d0f82-dd6f-4833-b528-562e9b8e5205" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 558.832028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d51d0f82-dd6f-4833-b528-562e9b8e5205" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 558.832028] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d51d0f82-dd6f-4833-b528-562e9b8e5205',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.236511] env[70287]: INFO networking_nsxv3.common.synchronization [None req-917c7448-a45f-49d9-8fa5-2600a89aa4cb None None] Enqueued Resource ID: c3aae1b9-650b-49b0-99e4-87292c175e94 with Priority: HIGHEST for action port [ 559.238024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3aae1b9-650b-49b0-99e4-87292c175e94 with Priority: HIGHEST for action port [ 559.238024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3aae1b9-650b-49b0-99e4-87292c175e94 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.238024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3aae1b9-650b-49b0-99e4-87292c175e94" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.238024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3aae1b9-650b-49b0-99e4-87292c175e94" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.238024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3aae1b9-650b-49b0-99e4-87292c175e94" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.238024] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3aae1b9-650b-49b0-99e4-87292c175e94',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.335035] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d51d0f82-dd6f-4833-b528-562e9b8e5205 [ 559.335035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.335035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.335035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.335035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.335035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.335035] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d51d0f82-dd6f-4833-b528-562e9b8e5205 already deleted. [ 559.335035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d51d0f82-dd6f-4833-b528-562e9b8e5205" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.459472] env[70287]: INFO networking_nsxv3.common.synchronization [None req-96400718-881d-45cf-9a5d-7f9bc4c4bb47 None None] Enqueued Resource ID: 65687560-473d-4d3b-93b6-f7b386d6161f with Priority: HIGHEST for action port [ 559.460320] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65687560-473d-4d3b-93b6-f7b386d6161f with Priority: HIGHEST for action port [ 559.460320] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-65687560-473d-4d3b-93b6-f7b386d6161f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.460493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65687560-473d-4d3b-93b6-f7b386d6161f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.460493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65687560-473d-4d3b-93b6-f7b386d6161f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.461982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65687560-473d-4d3b-93b6-f7b386d6161f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.461982] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65687560-473d-4d3b-93b6-f7b386d6161f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.742752] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3aae1b9-650b-49b0-99e4-87292c175e94 [ 559.742752] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.742938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.742938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.743252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.743645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.744863] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3aae1b9-650b-49b0-99e4-87292c175e94 already deleted. [ 559.744863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3aae1b9-650b-49b0-99e4-87292c175e94" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.814498] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d74627b8-b191-478b-bcbd-15c98ff06933 None None] Enqueued Resource ID: b9caee76-abd7-4379-a1d8-4f4fb1186e02 with Priority: HIGHEST for action port [ 559.814746] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9caee76-abd7-4379-a1d8-4f4fb1186e02 with Priority: HIGHEST for action port [ 559.815489] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9caee76-abd7-4379-a1d8-4f4fb1186e02 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.815489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9caee76-abd7-4379-a1d8-4f4fb1186e02" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.815489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9caee76-abd7-4379-a1d8-4f4fb1186e02" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.815747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9caee76-abd7-4379-a1d8-4f4fb1186e02" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.815832] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9caee76-abd7-4379-a1d8-4f4fb1186e02',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 559.964696] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65687560-473d-4d3b-93b6-f7b386d6161f [ 559.965046] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 559.965700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 559.965983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 559.966349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 559.966517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 559.966653] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65687560-473d-4d3b-93b6-f7b386d6161f already deleted. [ 559.966804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65687560-473d-4d3b-93b6-f7b386d6161f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.319604] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b9caee76-abd7-4379-a1d8-4f4fb1186e02 [ 560.319604] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.319604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.319938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.320195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.320292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.320499] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b9caee76-abd7-4379-a1d8-4f4fb1186e02 already deleted. [ 560.320499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9caee76-abd7-4379-a1d8-4f4fb1186e02" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.543738] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fb868084-2d02-479d-bf10-46ab10f2e2ba None None] Enqueued Resource ID: ba47f0ec-930a-42eb-b635-5015af5dec2f with Priority: HIGHEST for action port [ 560.543738] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba47f0ec-930a-42eb-b635-5015af5dec2f with Priority: HIGHEST for action port [ 560.547767] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba47f0ec-930a-42eb-b635-5015af5dec2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.547767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba47f0ec-930a-42eb-b635-5015af5dec2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.547767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba47f0ec-930a-42eb-b635-5015af5dec2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.547990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba47f0ec-930a-42eb-b635-5015af5dec2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.548078] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba47f0ec-930a-42eb-b635-5015af5dec2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 560.947488] env[70287]: INFO networking_nsxv3.common.synchronization [None req-57d66a8b-afc9-4230-ac05-195baf0db7aa None None] Enqueued Resource ID: 0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de with Priority: HIGHEST for action port [ 560.947749] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de with Priority: HIGHEST for action port [ 560.948324] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 560.948454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 560.948525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 560.948770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 560.948935] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 561.052803] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba47f0ec-930a-42eb-b635-5015af5dec2f [ 561.053482] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.053482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.053482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.053482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.053482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.053819] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba47f0ec-930a-42eb-b635-5015af5dec2f already deleted. [ 561.053819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba47f0ec-930a-42eb-b635-5015af5dec2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.452122] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de [ 561.452409] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 561.452712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 561.452712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 561.452854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 561.452902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 561.453012] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de already deleted. [ 561.453112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bbacfc9-5693-4ca1-912a-c0eaf9b3c9de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 562.506617] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d13a65be-ecce-4e39-9b9c-d178669c8de1 None None] Enqueued Resource ID: ab34b00f-b193-4918-9de7-8d1bbc619f2d with Priority: HIGHEST for action port [ 562.506617] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab34b00f-b193-4918-9de7-8d1bbc619f2d with Priority: HIGHEST for action port [ 562.506617] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab34b00f-b193-4918-9de7-8d1bbc619f2d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 562.506617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab34b00f-b193-4918-9de7-8d1bbc619f2d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 562.506617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab34b00f-b193-4918-9de7-8d1bbc619f2d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 562.506617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab34b00f-b193-4918-9de7-8d1bbc619f2d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 562.506617] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab34b00f-b193-4918-9de7-8d1bbc619f2d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.009947] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab34b00f-b193-4918-9de7-8d1bbc619f2d [ 563.009947] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.009947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.009947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.011703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.012489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.012489] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab34b00f-b193-4918-9de7-8d1bbc619f2d already deleted. [ 563.012489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab34b00f-b193-4918-9de7-8d1bbc619f2d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.335517] env[70287]: INFO networking_nsxv3.common.synchronization [None req-85a95dff-3535-49ef-9a82-59692cd284e5 None None] Enqueued Resource ID: fe3a3c1c-64e1-4292-9038-523cd8b34967 with Priority: HIGHEST for action port [ 563.335517] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe3a3c1c-64e1-4292-9038-523cd8b34967 with Priority: HIGHEST for action port [ 563.335517] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe3a3c1c-64e1-4292-9038-523cd8b34967 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.335517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe3a3c1c-64e1-4292-9038-523cd8b34967" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.335517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe3a3c1c-64e1-4292-9038-523cd8b34967" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.335816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe3a3c1c-64e1-4292-9038-523cd8b34967" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.335816] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe3a3c1c-64e1-4292-9038-523cd8b34967',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 563.843497] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe3a3c1c-64e1-4292-9038-523cd8b34967 [ 563.843497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 563.843497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 563.843497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 563.843497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 563.843497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 563.843497] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe3a3c1c-64e1-4292-9038-523cd8b34967 already deleted. [ 563.843497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe3a3c1c-64e1-4292-9038-523cd8b34967" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.109034] env[70287]: INFO networking_nsxv3.common.synchronization [None req-42e2d626-2dae-4ff4-a5db-86ce0b3d53f2 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_rules [ 564.109178] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_rules [ 564.110015] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.112033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.112856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.113786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.113876] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.506659] env[70287]: INFO networking_nsxv3.common.synchronization [None req-a92d3f4e-4097-4ac6-8ad6-fbedc2c8ecb8 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_rules [ 564.509269] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_rules [ 564.511509] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d7b7dfa4-904a-4cb9-b637-8e1e4fc2841c None None] Enqueued Resource ID: 63105676-3258-4e86-ba40-d59a8770c2f5 with Priority: HIGHEST for action port [ 564.511926] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.512670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.513071] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63105676-3258-4e86-ba40-d59a8770c2f5 with Priority: HIGHEST for action port [ 564.513340] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-63105676-3258-4e86-ba40-d59a8770c2f5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.513448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63105676-3258-4e86-ba40-d59a8770c2f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.513513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63105676-3258-4e86-ba40-d59a8770c2f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.513759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63105676-3258-4e86-ba40-d59a8770c2f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.513835] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63105676-3258-4e86-ba40-d59a8770c2f5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 564.638863] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 564.638863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 564.638863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.638863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.638863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.638863] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b already deleted. [ 564.638863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 564.638863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 564.638863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 564.638863] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.020555] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63105676-3258-4e86-ba40-d59a8770c2f5 [ 565.020881] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.020971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.021037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.022209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.022209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.022209] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63105676-3258-4e86-ba40-d59a8770c2f5 already deleted. [ 565.022209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63105676-3258-4e86-ba40-d59a8770c2f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.159315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.160343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.160343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.160343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.160343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.160343] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b already deleted. [ 565.160343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.350409] env[70287]: INFO networking_nsxv3.common.synchronization [None req-059d13e5-2ee0-40fd-ad21-61b86ac77aee None None] Enqueued Resource ID: 63ef39f5-90fc-406c-b83e-f738b104caac with Priority: HIGHEST for action port [ 565.351163] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63ef39f5-90fc-406c-b83e-f738b104caac with Priority: HIGHEST for action port [ 565.351861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-63ef39f5-90fc-406c-b83e-f738b104caac taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.352023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63ef39f5-90fc-406c-b83e-f738b104caac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.352118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63ef39f5-90fc-406c-b83e-f738b104caac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.352949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63ef39f5-90fc-406c-b83e-f738b104caac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.352949] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63ef39f5-90fc-406c-b83e-f738b104caac',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.473203] env[70287]: INFO networking_nsxv3.common.synchronization [None req-c0ec256a-5489-45f3-84b3-b37276374768 None None] Enqueued Resource ID: 03cf56a1-f704-4e62-83a1-940113b2ca96 with Priority: HIGHEST for action port [ 565.473203] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03cf56a1-f704-4e62-83a1-940113b2ca96 with Priority: HIGHEST for action port [ 565.473203] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-03cf56a1-f704-4e62-83a1-940113b2ca96 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.473203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03cf56a1-f704-4e62-83a1-940113b2ca96" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.473203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03cf56a1-f704-4e62-83a1-940113b2ca96" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.473203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03cf56a1-f704-4e62-83a1-940113b2ca96" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.473203] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03cf56a1-f704-4e62-83a1-940113b2ca96',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.660152] env[70287]: INFO networking_nsxv3.common.synchronization [None req-77bd8a9a-a038-4e25-b0e8-fbd14236de15 None None] Enqueued Resource ID: cfa4ba37-db79-4a3f-bdf6-84c768a864a6 with Priority: HIGHEST for action port [ 565.666967] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfa4ba37-db79-4a3f-bdf6-84c768a864a6 with Priority: HIGHEST for action port [ 565.670810] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfa4ba37-db79-4a3f-bdf6-84c768a864a6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.670810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfa4ba37-db79-4a3f-bdf6-84c768a864a6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.670810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfa4ba37-db79-4a3f-bdf6-84c768a864a6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.671451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfa4ba37-db79-4a3f-bdf6-84c768a864a6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.671451] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfa4ba37-db79-4a3f-bdf6-84c768a864a6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 565.856408] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63ef39f5-90fc-406c-b83e-f738b104caac [ 565.856642] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.856780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.856855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.857084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.857179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.857281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63ef39f5-90fc-406c-b83e-f738b104caac already deleted. [ 565.857353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63ef39f5-90fc-406c-b83e-f738b104caac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.975529] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 03cf56a1-f704-4e62-83a1-940113b2ca96 [ 565.975802] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 565.975943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 565.976027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 565.976262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 565.976344] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 565.976446] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:03cf56a1-f704-4e62-83a1-940113b2ca96 already deleted. [ 565.976770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03cf56a1-f704-4e62-83a1-940113b2ca96" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.002242] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9829fb2e-8029-4b8a-82e6-3e6090655221 None None] Enqueued Resource ID: 2bb3af86-8418-46f6-8119-9cfc560d3a9a with Priority: HIGHEST for action port [ 566.002538] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bb3af86-8418-46f6-8119-9cfc560d3a9a with Priority: HIGHEST for action port [ 566.003273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bb3af86-8418-46f6-8119-9cfc560d3a9a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.003405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bb3af86-8418-46f6-8119-9cfc560d3a9a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.003681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bb3af86-8418-46f6-8119-9cfc560d3a9a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.003767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bb3af86-8418-46f6-8119-9cfc560d3a9a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.003830] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bb3af86-8418-46f6-8119-9cfc560d3a9a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.175201] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cfa4ba37-db79-4a3f-bdf6-84c768a864a6 [ 566.175541] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.176543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.176543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.176543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.176543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.176707] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cfa4ba37-db79-4a3f-bdf6-84c768a864a6 already deleted. [ 566.177032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfa4ba37-db79-4a3f-bdf6-84c768a864a6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.343634] env[70287]: INFO networking_nsxv3.common.synchronization [None req-907ee3ca-0226-4dbf-875e-85ccc7018cd2 None None] Enqueued Resource ID: 9bbba409-f799-41e7-b288-1068243b504b with Priority: HIGHEST for action port [ 566.343885] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bbba409-f799-41e7-b288-1068243b504b with Priority: HIGHEST for action port [ 566.344435] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bbba409-f799-41e7-b288-1068243b504b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.344562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bbba409-f799-41e7-b288-1068243b504b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.344635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bbba409-f799-41e7-b288-1068243b504b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.344871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bbba409-f799-41e7-b288-1068243b504b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.344965] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bbba409-f799-41e7-b288-1068243b504b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.505481] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bb3af86-8418-46f6-8119-9cfc560d3a9a [ 566.505747] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.505895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.505968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.506200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.506297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.506395] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bb3af86-8418-46f6-8119-9cfc560d3a9a already deleted. [ 566.506521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bb3af86-8418-46f6-8119-9cfc560d3a9a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.841359] env[70287]: INFO networking_nsxv3.common.synchronization [req-04ae0f4e-61dd-4c79-8648-49cb9b05476f req-ad1dc0b6-6256-4fe5-a30c-69606f887114 tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 566.841897] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 566.843361] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.843748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.843748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.844152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.844152] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.844152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.844152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.844319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.844360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.844465] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 566.847270] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bbba409-f799-41e7-b288-1068243b504b [ 566.847270] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.847270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.847270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.847564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.847564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.847564] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bbba409-f799-41e7-b288-1068243b504b already deleted. [ 566.847671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bbba409-f799-41e7-b288-1068243b504b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 566.885690] env[70287]: INFO networking_nsxv3.common.synchronization [None req-637bd70b-00f8-48c5-bcc0-f5d3eac30233 tempest-ServersTestBootFromVolume-1362117415 tempest-ServersTestBootFromVolume-1362117415-project-member] Enqueued Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_rules [ 566.886077] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_rules [ 566.886244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 566.886321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 566.886457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 566.886716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 566.886796] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.151723] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f8f4541f-d834-46b5-b5be-41c9b5e8d56b tempest-ServersTestBootFromVolume-1362117415 tempest-ServersTestBootFromVolume-1362117415-project-member] Enqueued Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_rules [ 567.152357] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_rules [ 567.152529] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.152629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.316837] env[70287]: INFO networking_nsxv3.common.synchronization [None req-38d6cafe-0072-4481-b775-4c5b912121a7 None None] Enqueued Resource ID: dcddbf6a-148a-4ba8-bc97-b9c476aa2608 with Priority: HIGHEST for action port [ 567.316837] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcddbf6a-148a-4ba8-bc97-b9c476aa2608 with Priority: HIGHEST for action port [ 567.316837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcddbf6a-148a-4ba8-bc97-b9c476aa2608 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.316837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcddbf6a-148a-4ba8-bc97-b9c476aa2608" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.316837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcddbf6a-148a-4ba8-bc97-b9c476aa2608" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.317607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcddbf6a-148a-4ba8-bc97-b9c476aa2608" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.317758] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcddbf6a-148a-4ba8-bc97-b9c476aa2608',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.346858] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.347037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.347120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.347378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.347476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.347670] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.347769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.347852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.348027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.348105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.348190] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 already deleted. [ 567.348268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.407741] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.408126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.408126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.408238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.408312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.408404] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e already deleted. [ 567.408628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.408716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.408811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.408898] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 567.823358] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcddbf6a-148a-4ba8-bc97-b9c476aa2608 [ 567.823631] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.823716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.823764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.823992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.824654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.824654] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcddbf6a-148a-4ba8-bc97-b9c476aa2608 already deleted. [ 567.824654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcddbf6a-148a-4ba8-bc97-b9c476aa2608" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.929129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 567.929313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 567.929369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 567.929640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 567.929640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 567.929962] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e already deleted. [ 567.929962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.361138] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.361138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.361138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.361138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.361138] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.364725] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.365024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.365446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.365939] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.366350] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 568.366598] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 568.366840] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 568.369017] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 568.369017] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 568.369017] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 568.369017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 568.390258] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 568.390258] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 568.390258] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 568.390258] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.390258] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-86ababb0-885b-4528-9ba7-2ce109c5e354 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.390258] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.390258] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.390258] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.390258] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ababb0-885b-4528-9ba7-2ce109c5e354',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.860272] env[70287]: INFO networking_nsxv3.common.synchronization [req-7dc03934-0423-4f36-b4d8-ba6cb3b36ca6 req-3f9fcc72-c80f-446a-a8a9-997dbfdf007e tempest-TenantUsagesTestJSON-1250854354 tempest-TenantUsagesTestJSON-1250854354-project-member] Enqueued Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_members [ 568.861248] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_members [ 568.861248] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.861248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.864234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.864234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.864234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.864234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.864234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.864234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.864234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.864234] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 568.894308] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.894308] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.897914] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.897914] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.897914] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.897914] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 86ababb0-885b-4528-9ba7-2ce109c5e354 not found, creating... [ 568.898882] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.898882] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.898882] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.898882] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.898882] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.900244] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.900244] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.900244] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.900244] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.900244] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.900244] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 86ababb0-885b-4528-9ba7-2ce109c5e354 is going to be created. [ 568.935437] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 568.936663] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 568.939589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 568.939589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 568.939589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 568.939589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.212111] env[70287]: INFO networking_nsxv3.common.synchronization [None req-73da527a-b6a2-47ab-a694-408f00856a9a None None] Enqueued Resource ID: 9251cc2c-2106-405e-b0d7-293c446e73ba with Priority: HIGHEST for action port [ 569.212984] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9251cc2c-2106-405e-b0d7-293c446e73ba with Priority: HIGHEST for action port [ 569.212984] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9251cc2c-2106-405e-b0d7-293c446e73ba taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.213100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9251cc2c-2106-405e-b0d7-293c446e73ba" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.213168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9251cc2c-2106-405e-b0d7-293c446e73ba" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.213412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9251cc2c-2106-405e-b0d7-293c446e73ba" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.213492] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9251cc2c-2106-405e-b0d7-293c446e73ba',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 569.366992] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.367259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.367259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.367454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.367454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.367623] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.367705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.367764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.367903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.367976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.368157] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bd48e89-cc58-4469-862d-723098d8ef49 already deleted. [ 569.368277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.717457] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9251cc2c-2106-405e-b0d7-293c446e73ba [ 569.717457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.717457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.717457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.718333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.718333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.718391] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9251cc2c-2106-405e-b0d7-293c446e73ba already deleted. [ 569.718453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9251cc2c-2106-405e-b0d7-293c446e73ba" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 569.776113] env[70287]: INFO networking_nsxv3.common.synchronization [None req-47160446-0642-4748-a27f-67cc2242d105 None None] Enqueued Resource ID: 90908454-0544-4764-8560-9a2c2a66c986 with Priority: HIGHEST for action port [ 569.776858] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90908454-0544-4764-8560-9a2c2a66c986 with Priority: HIGHEST for action port [ 569.777097] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-90908454-0544-4764-8560-9a2c2a66c986 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.777265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90908454-0544-4764-8560-9a2c2a66c986" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.777337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90908454-0544-4764-8560-9a2c2a66c986" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.777531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90908454-0544-4764-8560-9a2c2a66c986" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.777601] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90908454-0544-4764-8560-9a2c2a66c986',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.280576] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90908454-0544-4764-8560-9a2c2a66c986 [ 570.280576] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.280576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.280701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.280817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.280911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.281037] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90908454-0544-4764-8560-9a2c2a66c986 already deleted. [ 570.281125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90908454-0544-4764-8560-9a2c2a66c986" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.385100] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fcdffe91-be17-4ae3-87d2-15b8b7938b40 tempest-ServersTestJSON-1206130467 tempest-ServersTestJSON-1206130467-project-member] Enqueued Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_rules [ 570.385696] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_rules [ 570.386187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.386954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.386954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.387272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.387373] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.404399] env[70287]: INFO networking_nsxv3.common.synchronization [req-04ae0f4e-61dd-4c79-8648-49cb9b05476f req-3a018f38-608e-4a04-8fb1-7a571db48462 service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 570.404572] env[70287]: INFO networking_nsxv3.common.synchronization [req-04ae0f4e-61dd-4c79-8648-49cb9b05476f req-3a018f38-608e-4a04-8fb1-7a571db48462 service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 570.404706] env[70287]: INFO networking_nsxv3.common.synchronization [req-04ae0f4e-61dd-4c79-8648-49cb9b05476f req-3a018f38-608e-4a04-8fb1-7a571db48462 service nova] Enqueued Resource ID: 86ababb0-885b-4528-9ba7-2ce109c5e354 with Priority: HIGHEST for action port [ 570.405181] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 570.405805] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 570.405805] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86ababb0-885b-4528-9ba7-2ce109c5e354 with Priority: HIGHEST for action port [ 570.405805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.405805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.405805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.407432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.407558] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.408461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.408583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.408651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.408838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.408993] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.409106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.409177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.409385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.409451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.409529] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.410699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-86ababb0-885b-4528-9ba7-2ce109c5e354 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.410788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.410835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.410995] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.411216] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86ababb0-885b-4528-9ba7-2ce109c5e354',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.425067] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.425170] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.425280] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.425677] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.426007] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.426309] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.426482] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.426988] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.427290] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.427526] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 570.427637] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 570.427749] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 570.427966] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 570.428643] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 570.428643] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 570.428643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 570.453457] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 570.453457] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 570.453602] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 570.453810] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.454087] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-164c6700-4276-487a-8c27-21f72a4cb568 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.454265] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.454387] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.454781] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.454891] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('164c6700-4276-487a-8c27-21f72a4cb568',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.569364] env[70287]: INFO networking_nsxv3.common.synchronization [None req-69438eef-9cc4-4151-97cf-9c1bf3b45558 tempest-ServersTestJSON-1206130467 tempest-ServersTestJSON-1206130467-project-member] Enqueued Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_rules [ 570.569364] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_rules [ 570.569364] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.569364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.910343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.910343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.910343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.910343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.910343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.910343] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc already deleted. [ 570.910343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.910343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.910343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.910343] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.914560] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.914677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.931660] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.934796] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 86ababb0-885b-4528-9ba7-2ce109c5e354 with status ACTIVE [ 570.935127] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.935263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.935329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.935539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.935629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.935979] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.936078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.936128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.936466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.936466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.936555] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.936614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.936698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.936797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.936880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.936966] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 86ababb0-885b-4528-9ba7-2ce109c5e354 is going to be updated. [ 570.958363] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.958363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.958363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.958363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.958363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.958363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86ababb0-885b-4528-9ba7-2ce109c5e354" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.958363] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.959019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.959019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.959019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.959935] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.961278] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 164c6700-4276-487a-8c27-21f72a4cb568 not found, creating... [ 570.961612] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.961789] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.961912] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.962161] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.962320] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.962643] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.962808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.962925] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.963184] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.963326] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.963475] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 164c6700-4276-487a-8c27-21f72a4cb568 is going to be created. [ 570.983548] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.983770] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.983888] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.984250] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.985061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.985333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.087507] env[70287]: INFO networking_nsxv3.common.synchronization [req-e1d07b44-50d4-4992-93eb-7246eca91a14 req-b77f9650-90b2-4e9b-95e3-3ea131e3e187 tempest-FloatingIPsAssociationNegativeTestJSON-1697391029 tempest-FloatingIPsAssociationNegativeTestJSON-1697391029-project-member] Enqueued Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_members [ 571.087507] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_members [ 571.087912] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f23e3805-622c-45be-b03e-1e0963f7a65e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.088057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.089505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.089505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.089505] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.089505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.089505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.089505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.089505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.089505] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.430722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.430722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.430722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.430722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.430722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.430722] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc already deleted. [ 571.430722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.434779] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.594204] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.594204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.594204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.595476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.595476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.595476] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.595476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.595476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.595476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.595476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.595476] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f23e3805-622c-45be-b03e-1e0963f7a65e already deleted. [ 571.595476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.937136] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.937136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.940526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.940526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.940526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.940526] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be created. [ 572.018267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.018614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.018614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.018614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.019730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.033333] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: UNINITIALIZED for 2s [ 572.705289] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-758 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.706683] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-758" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.706683] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-758" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.706683] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-758" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.706683] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.707321] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.711252] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.711252] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.711252] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.711252] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 572.711252] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 572.711252] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 572.711252] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 572.711252] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 572.711252] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 572.711252] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 572.729377] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 572.729377] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 572.729377] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 572.729377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-758" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.729377] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-6a4ebc4a-adba-4add-8d55-366373467c88 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.729377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.729377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.730110] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.730110] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4ebc4a-adba-4add-8d55-366373467c88',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.076254] env[70287]: INFO networking_nsxv3.common.synchronization [req-7dc03934-0423-4f36-b4d8-ba6cb3b36ca6 req-2d64295c-0836-4504-86c1-690548440808 service nova] Enqueued Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_rules [ 573.076438] env[70287]: INFO networking_nsxv3.common.synchronization [req-7dc03934-0423-4f36-b4d8-ba6cb3b36ca6 req-2d64295c-0836-4504-86c1-690548440808 service nova] Enqueued Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_members [ 573.076596] env[70287]: INFO networking_nsxv3.common.synchronization [req-7dc03934-0423-4f36-b4d8-ba6cb3b36ca6 req-2d64295c-0836-4504-86c1-690548440808 service nova] Enqueued Resource ID: 164c6700-4276-487a-8c27-21f72a4cb568 with Priority: HIGHEST for action port [ 573.076844] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_rules [ 573.077027] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_members [ 573.077106] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 164c6700-4276-487a-8c27-21f72a4cb568 with Priority: HIGHEST for action port [ 573.077718] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.079321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.079321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.079523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.079607] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.081467] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.081587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.081652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.081839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.082017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.082111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.082173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.082594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.082594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.082594] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.086299] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-164c6700-4276-487a-8c27-21f72a4cb568 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.086299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.086382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.086562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.086630] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('164c6700-4276-487a-8c27-21f72a4cb568',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.089466] env[70287]: INFO networking_nsxv3.common.synchronization [None req-94c463a8-d606-4fdc-98f9-00fe2c1c8ac1 None None] Enqueued Resource ID: ed94e2a9-2fae-454d-8391-59124e9d3f91 with Priority: HIGHEST for action port [ 573.089816] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed94e2a9-2fae-454d-8391-59124e9d3f91 with Priority: HIGHEST for action port [ 573.090899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed94e2a9-2fae-454d-8391-59124e9d3f91 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.090899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed94e2a9-2fae-454d-8391-59124e9d3f91" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.090899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed94e2a9-2fae-454d-8391-59124e9d3f91" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.091073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed94e2a9-2fae-454d-8391-59124e9d3f91" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.091135] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed94e2a9-2fae-454d-8391-59124e9d3f91',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.236692] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.236993] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.237141] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.238250] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.240922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.240922] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 6a4ebc4a-adba-4add-8d55-366373467c88 not found, creating... [ 573.240922] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.240922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.240922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.240922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.240922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.240922] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.242397] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.242397] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.242632] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.242768] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.242886] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 6a4ebc4a-adba-4add-8d55-366373467c88 is going to be created. [ 573.262460] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.262693] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.265620] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.265620] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.265620] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.265620] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.341358] env[70287]: INFO networking_nsxv3.common.synchronization [req-47a47bfa-2ecd-45bf-9461-cdb0ca124bc5 req-5b7452b7-84fe-4843-b251-ae63f790981b tempest-ImagesNegativeTestJSON-1101893703 tempest-ImagesNegativeTestJSON-1101893703-project-member] Enqueued Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_members [ 573.341900] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_members [ 573.342216] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.342353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.342416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.342693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.342846] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.342982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.343026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.343172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.343282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.343419] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.587026] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.591432] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.591432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.591600] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 164c6700-4276-487a-8c27-21f72a4cb568 with status ACTIVE [ 573.591763] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.591867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.591929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.592145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.592225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.592672] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.592672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.592672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.592949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.592949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.593048] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.593112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.593158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.593262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.593326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.593416] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 164c6700-4276-487a-8c27-21f72a4cb568 is going to be updated. [ 573.594533] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed94e2a9-2fae-454d-8391-59124e9d3f91 [ 573.594703] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.594789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.594858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.595265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.595265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.595265] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed94e2a9-2fae-454d-8391-59124e9d3f91 already deleted. [ 573.595265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed94e2a9-2fae-454d-8391-59124e9d3f91" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.615297] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.615435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.615502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.615698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.615820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.615983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-164c6700-4276-487a-8c27-21f72a4cb568" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.703508] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f7098f3e-76b9-49df-a902-4af668c0a7b9 None None] Enqueued Resource ID: 935cf865-af2d-496d-b3dc-504204cf7918 with Priority: HIGHEST for action port [ 573.704049] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 935cf865-af2d-496d-b3dc-504204cf7918 with Priority: HIGHEST for action port [ 573.705676] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-935cf865-af2d-496d-b3dc-504204cf7918 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.705676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-935cf865-af2d-496d-b3dc-504204cf7918" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.705676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-935cf865-af2d-496d-b3dc-504204cf7918" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.705676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-935cf865-af2d-496d-b3dc-504204cf7918" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.705676] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('935cf865-af2d-496d-b3dc-504204cf7918',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.847701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.849535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.849535] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbadb315-bfe6-4947-b23f-861ec4456d95 already deleted. [ 573.849535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.023184] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-95 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.024268] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.024268] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.029442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.029442] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.029442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.029442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.029442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.029442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.029442] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 574.029442] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 574.029442] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 574.029442] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 574.029442] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 574.029442] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 574.029442] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 574.048850] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 574.049130] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 574.049354] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 574.049582] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.049964] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-d8f504a4-35b9-4e59-8940-9702a2050fa5 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.050253] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.050642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.051118] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.051238] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8f504a4-35b9-4e59-8940-9702a2050fa5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.053689] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 574.053689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.053968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.054952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.055233] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.055439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.055547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.055804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.056161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.056161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.056449] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.091552] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.210885] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 935cf865-af2d-496d-b3dc-504204cf7918 [ 574.210885] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.210885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.210885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.210885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.210885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.210885] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:935cf865-af2d-496d-b3dc-504204cf7918 already deleted. [ 574.210885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-935cf865-af2d-496d-b3dc-504204cf7918" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.558898] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.559102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.559351] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.559715] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.560111] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.560247] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port d8f504a4-35b9-4e59-8940-9702a2050fa5 not found, creating... [ 574.560560] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.560679] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.560806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.561127] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.561475] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.562553] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.562553] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.562553] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.562946] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.563026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.563182] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: d8f504a4-35b9-4e59-8940-9702a2050fa5 is going to be created. [ 574.566343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.566343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.566343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.566343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.566343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.566944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.567445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.567509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.567540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.567630] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.586760] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.586981] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.587117] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.587405] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.587636] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.587858] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.594728] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.594728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.594728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.594728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.594955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.595178] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bd48e89-cc58-4469-862d-723098d8ef49 is going to be created. [ 574.616327] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.616327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.616327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.617177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.617415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.629642] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bd48e89-cc58-4469-862d-723098d8ef49 in Status: UNINITIALIZED for 2s [ 574.698138] env[70287]: INFO networking_nsxv3.common.synchronization [req-e1d07b44-50d4-4992-93eb-7246eca91a14 req-ca09d109-290c-4aaf-98e1-f5d4681af37d service nova] Enqueued Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_rules [ 574.698138] env[70287]: INFO networking_nsxv3.common.synchronization [req-e1d07b44-50d4-4992-93eb-7246eca91a14 req-ca09d109-290c-4aaf-98e1-f5d4681af37d service nova] Enqueued Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_members [ 574.698138] env[70287]: INFO networking_nsxv3.common.synchronization [req-e1d07b44-50d4-4992-93eb-7246eca91a14 req-ca09d109-290c-4aaf-98e1-f5d4681af37d service nova] Enqueued Resource ID: 6a4ebc4a-adba-4add-8d55-366373467c88 with Priority: HIGHEST for action port [ 574.698138] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_rules [ 574.698138] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_members [ 574.698138] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a4ebc4a-adba-4add-8d55-366373467c88 with Priority: HIGHEST for action port [ 574.700618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f23e3805-622c-45be-b03e-1e0963f7a65e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.700618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.700618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.700618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.700618] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.700618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f23e3805-622c-45be-b03e-1e0963f7a65e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.700618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.700618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.700618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.700987] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.701896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.701979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.702201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.702238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.702851] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.703419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a4ebc4a-adba-4add-8d55-366373467c88 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.703535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.703600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.703753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.703823] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a4ebc4a-adba-4add-8d55-366373467c88',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.074504] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5344b0-d8f6-49cd-abc4-1a415b3aa399: rpc.has_security_group_logging(os_id): False [ 575.094614] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.094835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.094929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.095362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.096385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.096688] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.096932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.096932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.097112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.097200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.097386] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.097478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.097536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.097677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.097746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.097924] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.102532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.102532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.102532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.102532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.102532] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be created. [ 575.187511] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.187511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.187511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.187511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.188046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.207297] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a4ebc4a-adba-4add-8d55-366373467c88 with status ACTIVE [ 575.207297] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.208195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.208760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.208760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.208760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.208938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.208988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.209439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.209439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.209439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.209565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.209626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.209658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.209819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.209859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.209940] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a4ebc4a-adba-4add-8d55-366373467c88 is going to be updated. [ 575.212023] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.216425] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f23e3805-622c-45be-b03e-1e0963f7a65e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.216425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.227583] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 575.259189] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.261533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.261533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.262777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.262777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.262777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a4ebc4a-adba-4add-8d55-366373467c88" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.722096] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.947230] env[70287]: INFO networking_nsxv3.common.synchronization [req-47a47bfa-2ecd-45bf-9461-cdb0ca124bc5 req-e02d01c4-2bcc-426d-8f62-133666a1bd63 service nova] Enqueued Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_rules [ 575.947230] env[70287]: INFO networking_nsxv3.common.synchronization [req-47a47bfa-2ecd-45bf-9461-cdb0ca124bc5 req-e02d01c4-2bcc-426d-8f62-133666a1bd63 service nova] Enqueued Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_members [ 575.947230] env[70287]: INFO networking_nsxv3.common.synchronization [req-47a47bfa-2ecd-45bf-9461-cdb0ca124bc5 req-e02d01c4-2bcc-426d-8f62-133666a1bd63 service nova] Enqueued Resource ID: d8f504a4-35b9-4e59-8940-9702a2050fa5 with Priority: HIGHEST for action port [ 575.947477] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_rules [ 575.947512] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_members [ 575.947604] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8f504a4-35b9-4e59-8940-9702a2050fa5 with Priority: HIGHEST for action port [ 575.948290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.948290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.948556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.948715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.948763] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.950153] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.950354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.950354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.950735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.950779] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.954220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.954220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.954220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.954220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.954220] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.954220] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8f504a4-35b9-4e59-8940-9702a2050fa5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.954220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.954220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.954220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.954220] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8f504a4-35b9-4e59-8940-9702a2050fa5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.979941] env[70287]: INFO networking_nsxv3.common.synchronization [req-376398d6-2a5a-4b33-ad99-1b8058338797 req-de08a158-f689-4a0c-b24d-4ad75b5aed74 tempest-ServerExternalEventsTest-948524789 tempest-ServerExternalEventsTest-948524789-project-member] Enqueued Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_members [ 575.979941] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_members [ 575.979941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.979941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.979941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.979941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.979941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.979941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.979941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.980379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.980379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.980379] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.229625] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.229941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.229941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.230243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.230243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.230316] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f23e3805-622c-45be-b03e-1e0963f7a65e is going to be created. [ 576.251915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.255022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.255022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.255022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.255022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.260786] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fce0dd5c-3790-4aba-8879-1f920619e718 None None] Enqueued Resource ID: a7ed742b-a3aa-4135-9da6-67304f60a545 with Priority: HIGHEST for action port [ 576.260786] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7ed742b-a3aa-4135-9da6-67304f60a545 with Priority: HIGHEST for action port [ 576.260786] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7ed742b-a3aa-4135-9da6-67304f60a545 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.260786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7ed742b-a3aa-4135-9da6-67304f60a545" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.260786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7ed742b-a3aa-4135-9da6-67304f60a545" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.260786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7ed742b-a3aa-4135-9da6-67304f60a545" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.260786] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7ed742b-a3aa-4135-9da6-67304f60a545',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.263635] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f23e3805-622c-45be-b03e-1e0963f7a65e in Status: UNINITIALIZED for 2s [ 576.301700] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f37e8db4-bb10-4de4-bc3e-f48a0a793791 tempest-VolumesAdminNegativeTest-1117785024 tempest-VolumesAdminNegativeTest-1117785024-project-member] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_rules [ 576.301700] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_rules [ 576.301700] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.301700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.301700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.301879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.301879] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.455387] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.455708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.455931] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.457226] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8f504a4-35b9-4e59-8940-9702a2050fa5 with status ACTIVE [ 576.457343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.457502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.457533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.457721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.457813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.461017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.461017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.461017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.461017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8f504a4-35b9-4e59-8940-9702a2050fa5 is going to be updated. [ 576.469692] env[70287]: INFO networking_nsxv3.common.synchronization [None req-a1f84562-a49c-4ce8-9db2-4f11fa5c3db8 tempest-VolumesAdminNegativeTest-1117785024 tempest-VolumesAdminNegativeTest-1117785024-project-member] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_rules [ 576.471118] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_rules [ 576.471817] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.472168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.480995] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.481156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.481214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.481424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.481594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.481764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8f504a4-35b9-4e59-8940-9702a2050fa5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.482078] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.482186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.482247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.482411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.482495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.482682] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.482769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.482829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.482974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.483840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.483918] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 already deleted. [ 576.484321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.638947] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bd48e89-cc58-4469-862d-723098d8ef49 in Status: SUCCESS [ 576.639181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.639336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.639553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.641023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.641023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.641023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.644292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.644292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.644292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.644292] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.762932] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7ed742b-a3aa-4135-9da6-67304f60a545 [ 576.763228] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.763363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.763428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.763678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.763787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.763896] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7ed742b-a3aa-4135-9da6-67304f60a545 already deleted. [ 576.763982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7ed742b-a3aa-4135-9da6-67304f60a545" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.798951] env[70287]: INFO networking_nsxv3.common.synchronization [None req-70f32aff-7e8f-4719-9264-7779231e7726 None None] Enqueued Resource ID: 23bf6075-4df1-49b6-87a0-99805c35fa63 with Priority: HIGHEST for action port [ 576.798951] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bf6075-4df1-49b6-87a0-99805c35fa63 with Priority: HIGHEST for action port [ 576.799206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-23bf6075-4df1-49b6-87a0-99805c35fa63 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.799317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23bf6075-4df1-49b6-87a0-99805c35fa63" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.799377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23bf6075-4df1-49b6-87a0-99805c35fa63" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.799690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23bf6075-4df1-49b6-87a0-99805c35fa63" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.799782] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23bf6075-4df1-49b6-87a0-99805c35fa63',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.823755] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.827659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.827795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.828040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.828207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.828242] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 already deleted. [ 576.828411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.829313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.829507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.829609] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.885927] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.886152] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.886282] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.886602] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.886835] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.887007] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.889293] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.889589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.889750] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.889982] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 576.890121] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 576.890246] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 576.890356] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 576.890480] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 576.890598] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 576.890813] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 576.913614] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 576.913853] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 576.913946] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 576.914318] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.915084] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.915344] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.916868] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.917232] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.917391] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.964279] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.043035] env[70287]: INFO networking_nsxv3.common.synchronization [None req-0d4e0367-9b55-4d70-bca6-f3800fcc1158 tempest-VolumesAssistedSnapshotsTest-104473246 tempest-VolumesAssistedSnapshotsTest-104473246-project-member] Enqueued Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_rules [ 577.043035] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_rules [ 577.043035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.043035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.043035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.043035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.043035] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.055095] env[70287]: INFO networking_nsxv3.common.synchronization [None req-42cef2b9-8842-476d-840e-a9f45c604130 None None] Enqueued Resource ID: 7208a796-41d7-4f18-8540-28b3b874ce10 with Priority: HIGHEST for action port [ 577.055095] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7208a796-41d7-4f18-8540-28b3b874ce10 with Priority: HIGHEST for action port [ 577.055095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7208a796-41d7-4f18-8540-28b3b874ce10 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.055095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7208a796-41d7-4f18-8540-28b3b874ce10" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.055095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7208a796-41d7-4f18-8540-28b3b874ce10" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.055095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7208a796-41d7-4f18-8540-28b3b874ce10" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.055095] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7208a796-41d7-4f18-8540-28b3b874ce10',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.145379] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.145814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.146035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.146317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.146632] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.146926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.149162] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.149162] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.149162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.149162] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.207326] env[70287]: INFO networking_nsxv3.common.synchronization [None req-74e9cfaf-25d5-41bd-a6fc-4c9d39f2d03b tempest-VolumesAssistedSnapshotsTest-104473246 tempest-VolumesAssistedSnapshotsTest-104473246-project-member] Enqueued Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_rules [ 577.208390] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_rules [ 577.208390] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.208390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.238108] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 577.238482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.304595] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23bf6075-4df1-49b6-87a0-99805c35fa63 [ 577.304736] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.304883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.304954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.305210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.305310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.305410] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23bf6075-4df1-49b6-87a0-99805c35fa63 already deleted. [ 577.305495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23bf6075-4df1-49b6-87a0-99805c35fa63" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.349398] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.350284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.350284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.350284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.350284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.350284] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 already deleted. [ 577.350284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.424047] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.424047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.424047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.424047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.424329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.424465] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c not found, creating... [ 577.425053] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.425053] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.425206] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.425433] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.425516] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.425761] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.426655] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.428859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.428859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.428859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.428859] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c is going to be created. [ 577.449552] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.449916] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.450159] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.450473] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.451165] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.453182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.466191] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fc6e6ab8-63de-4e35-a972-088c961aabfb None None] Enqueued Resource ID: cd20cff1-4d2f-40ca-8d43-1b5a2c29321e with Priority: HIGHEST for action port [ 577.466674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.466862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.467950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.467950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.467950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.467950] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbadb315-bfe6-4947-b23f-861ec4456d95 is going to be created. [ 577.469030] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd20cff1-4d2f-40ca-8d43-1b5a2c29321e with Priority: HIGHEST for action port [ 577.469681] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd20cff1-4d2f-40ca-8d43-1b5a2c29321e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.469989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd20cff1-4d2f-40ca-8d43-1b5a2c29321e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.470156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd20cff1-4d2f-40ca-8d43-1b5a2c29321e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.470392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd20cff1-4d2f-40ca-8d43-1b5a2c29321e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.470494] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd20cff1-4d2f-40ca-8d43-1b5a2c29321e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.493125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.493695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.493695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.493965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.494394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.504006] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbadb315-bfe6-4947-b23f-861ec4456d95 in Status: UNINITIALIZED for 2s [ 577.559478] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7208a796-41d7-4f18-8540-28b3b874ce10 [ 577.559478] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.559478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.559478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.559478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.559478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.559478] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7208a796-41d7-4f18-8540-28b3b874ce10 already deleted. [ 577.559478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7208a796-41d7-4f18-8540-28b3b874ce10" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.586612] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.586833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.586905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.587778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.587778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.587778] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 already deleted. [ 577.587778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.588120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.588281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.588356] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.651298] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1bd48e89-cc58-4469-862d-723098d8ef49: rpc.has_security_group_logging(os_id): False [ 577.682660] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.683134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.683228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.685840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.685840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.685840] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.685840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.685840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.691139] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.691139] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.691139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.698471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.698471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.698471] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bd48e89-cc58-4469-862d-723098d8ef49 is going to be created. [ 577.765015] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.765015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.765015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.765015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.765353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.780271] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bd48e89-cc58-4469-862d-723098d8ef49 in Status: IN_PROGRESS for 2s [ 577.842350] env[70287]: INFO networking_nsxv3.common.synchronization [None req-e58c545d-927f-4d36-9a35-5c2164bdc0a8 None None] Enqueued Resource ID: db3f0c55-51b6-4155-b072-7979eae53fc8 with Priority: HIGHEST for action port [ 577.842976] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3f0c55-51b6-4155-b072-7979eae53fc8 with Priority: HIGHEST for action port [ 577.848637] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-db3f0c55-51b6-4155-b072-7979eae53fc8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.848812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db3f0c55-51b6-4155-b072-7979eae53fc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.848935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db3f0c55-51b6-4155-b072-7979eae53fc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.849264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db3f0c55-51b6-4155-b072-7979eae53fc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.849379] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3f0c55-51b6-4155-b072-7979eae53fc8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.975435] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd20cff1-4d2f-40ca-8d43-1b5a2c29321e [ 577.976877] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.976877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.976877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.976877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.976877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.976877] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd20cff1-4d2f-40ca-8d43-1b5a2c29321e already deleted. [ 577.976877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd20cff1-4d2f-40ca-8d43-1b5a2c29321e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.995982] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ad9df34-ec8e-4396-bf09-0e9b51311ba2 req-6e830ef0-95eb-47d4-8926-a39c231bffa0 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_members [ 577.996751] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_members [ 577.997180] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.997326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.997374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.997753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.997952] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.998101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.998201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.998420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.998453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.998524] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.112014] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.113315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.113315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.113315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.113315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.113315] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 already deleted. [ 578.113315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.274381] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f23e3805-622c-45be-b03e-1e0963f7a65e in Status: SUCCESS [ 578.274627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.276130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.276130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.276130] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.276130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.276130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.276130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.276130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.276130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.276669] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.354028] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db3f0c55-51b6-4155-b072-7979eae53fc8 [ 578.354028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.354828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.354828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.354828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.355861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.355861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db3f0c55-51b6-4155-b072-7979eae53fc8 already deleted. [ 578.355861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db3f0c55-51b6-4155-b072-7979eae53fc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.490844] env[70287]: INFO networking_nsxv3.common.synchronization [None req-4f5ccc12-f17d-4a12-8ec3-76af7b4f1476 None None] Enqueued Resource ID: a2d6aee0-3262-4f69-bdfb-bb41cae14a3f with Priority: HIGHEST for action port [ 578.490844] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2d6aee0-3262-4f69-bdfb-bb41cae14a3f with Priority: HIGHEST for action port [ 578.490844] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2d6aee0-3262-4f69-bdfb-bb41cae14a3f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.490844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2d6aee0-3262-4f69-bdfb-bb41cae14a3f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.490844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2d6aee0-3262-4f69-bdfb-bb41cae14a3f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.491064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2d6aee0-3262-4f69-bdfb-bb41cae14a3f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.491064] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2d6aee0-3262-4f69-bdfb-bb41cae14a3f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.501047] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.501211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.501401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.501503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.501601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.502244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.502244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.502244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.503969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.503969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.504118] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b already deleted. [ 578.504453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.672940] env[70287]: INFO networking_nsxv3.common.synchronization [req-376398d6-2a5a-4b33-ad99-1b8058338797 req-ef2ba9f4-94fb-42fc-ad20-5b42bfd7aba3 service nova] Enqueued Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_rules [ 578.672940] env[70287]: INFO networking_nsxv3.common.synchronization [req-376398d6-2a5a-4b33-ad99-1b8058338797 req-ef2ba9f4-94fb-42fc-ad20-5b42bfd7aba3 service nova] Enqueued Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_members [ 578.672940] env[70287]: INFO networking_nsxv3.common.synchronization [req-376398d6-2a5a-4b33-ad99-1b8058338797 req-ef2ba9f4-94fb-42fc-ad20-5b42bfd7aba3 service nova] Enqueued Resource ID: bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c with Priority: HIGHEST for action port [ 578.672940] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_rules [ 578.672940] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_members [ 578.672940] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c with Priority: HIGHEST for action port [ 578.672940] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.672940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.672940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.672940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.672940] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.673734] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.673816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.673850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.674157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.674345] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.674472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.675150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.675150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.675150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.675150] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.676111] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.676111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.676111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.676111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.676111] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.693696] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.693926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.694012] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.694352] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.694611] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.698514] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.698514] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.698514] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.698514] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.698514] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 578.698514] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 578.698514] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 578.698514] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 578.698514] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 578.698514] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 578.698514] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 578.714478] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 578.714595] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 578.714711] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 578.714931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.715351] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-e7caa92f-9245-47ed-bd2c-81565fa87826 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.715604] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.715762] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.716119] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.716760] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7caa92f-9245-47ed-bd2c-81565fa87826',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.781910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f23e3805-622c-45be-b03e-1e0963f7a65e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.781910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.781910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f23e3805-622c-45be-b03e-1e0963f7a65e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.781910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.781910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.782862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.782862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.782862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.782862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.782862] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.995730] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a2d6aee0-3262-4f69-bdfb-bb41cae14a3f [ 578.996124] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.996297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.996828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.997503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.997503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.997503] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a2d6aee0-3262-4f69-bdfb-bb41cae14a3f already deleted. [ 578.997503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2d6aee0-3262-4f69-bdfb-bb41cae14a3f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.178304] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.180040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.180040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.180040] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c with status ACTIVE [ 579.180040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.180040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.180040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.180334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.180334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.182667] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.182667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.182667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.182667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.182667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.182667] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.185783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.185783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.185783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.185783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.185783] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c is going to be updated. [ 579.208457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.209125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.209243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.209491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.209668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.209834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf4f5dfc-c7be-43cf-b89c-6805bb02fa0c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.218988] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.219243] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.219470] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.219760] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.219954] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.220138] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port e7caa92f-9245-47ed-bd2c-81565fa87826 not found, creating... [ 579.220435] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.220744] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.220744] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.220976] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.221127] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.221421] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.221622] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.221748] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.222033] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.223862] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.225737] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: e7caa92f-9245-47ed-bd2c-81565fa87826 is going to be created. [ 579.286025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f23e3805-622c-45be-b03e-1e0963f7a65e: rpc.has_security_group_logging(os_id): False [ 579.296386] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.296386] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.296497] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.296808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.297060] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.297294] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.306343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.306513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.306559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.306748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.306841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.307172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.307311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.307394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.307570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.307706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.307897] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.308433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.308509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.308669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.308748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.309056] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.309180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.309245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.309396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.310722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.310722] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f23e3805-622c-45be-b03e-1e0963f7a65e is going to be created. [ 579.391791] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.391791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.391791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.392651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.393449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.414519] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f23e3805-622c-45be-b03e-1e0963f7a65e in Status: IN_PROGRESS for 2s [ 579.518220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbadb315-bfe6-4947-b23f-861ec4456d95 in Status: SUCCESS [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.518220] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.518220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.518220] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.687988] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.799129] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1bd48e89-cc58-4469-862d-723098d8ef49 in Status: SUCCESS [ 579.803021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.021594] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.021787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.021847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.022182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.022285] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.022366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.022366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.022842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.023947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.024074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.024237] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.024337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.024402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.025258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.025315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.025452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.025483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.025707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.025707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.025802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.026049] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.192582] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.193598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.193598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.193682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.193789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.193894] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 is going to be created. [ 580.221211] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.221377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.221448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.221689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.221878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.231704] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 in Status: UNINITIALIZED for 2s [ 580.364849] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ad9df34-ec8e-4396-bf09-0e9b51311ba2 req-ed1989ea-09a2-4c13-a6f3-6e7bad878d9f service nova] Enqueued Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_rules [ 580.365123] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ad9df34-ec8e-4396-bf09-0e9b51311ba2 req-ed1989ea-09a2-4c13-a6f3-6e7bad878d9f service nova] Enqueued Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_members [ 580.365193] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ad9df34-ec8e-4396-bf09-0e9b51311ba2 req-ed1989ea-09a2-4c13-a6f3-6e7bad878d9f service nova] Enqueued Resource ID: e7caa92f-9245-47ed-bd2c-81565fa87826 with Priority: HIGHEST for action port [ 580.366212] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_rules [ 580.366212] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_members [ 580.366212] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7caa92f-9245-47ed-bd2c-81565fa87826 with Priority: HIGHEST for action port [ 580.366814] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.366814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.366814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.366814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.366968] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.367899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.368565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.368681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.372591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.372591] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.372704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.372704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.372901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.372983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.373097] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.375881] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7caa92f-9245-47ed-bd2c-81565fa87826 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.375881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.375881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.375881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.375881] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7caa92f-9245-47ed-bd2c-81565fa87826',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.533858] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbadb315-bfe6-4947-b23f-861ec4456d95: rpc.has_security_group_logging(os_id): False [ 580.553020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.553020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.553020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.553020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.555053] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.555053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.555757] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbadb315-bfe6-4947-b23f-861ec4456d95 is going to be created. [ 580.617497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.617497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.617497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.617731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.617731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.630282] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbadb315-bfe6-4947-b23f-861ec4456d95 in Status: IN_PROGRESS for 2s [ 580.880190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.880190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.880190] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.880190] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7caa92f-9245-47ed-bd2c-81565fa87826 with status ACTIVE [ 580.880190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.880190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.880190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.880190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.880190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.880190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.880899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.884233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.884233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.884233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.884233] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.884233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.884233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.884233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.884233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.884233] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7caa92f-9245-47ed-bd2c-81565fa87826 is going to be updated. [ 580.902121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.902121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.902121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.902281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.902425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.902644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7caa92f-9245-47ed-bd2c-81565fa87826" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.385357] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.426064] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f23e3805-622c-45be-b03e-1e0963f7a65e in Status: SUCCESS [ 581.426781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.785398] env[70287]: INFO networking_nsxv3.common.synchronization [None req-3a171eae-37ef-4c89-b080-79ec6569f50d tempest-ServersWithSpecificFlavorTestJSON-185056864 tempest-ServersWithSpecificFlavorTestJSON-185056864-project-member] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 581.785398] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 581.785398] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.785398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.785398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.785398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.785398] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.887168] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.887366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.888791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.889085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.889190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.889295] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b is going to be created. [ 581.912374] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.912374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.912374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.914183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.914183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.923773] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64eebc83-d0e6-4418-b651-efae0fdea09b in Status: UNINITIALIZED for 2s [ 581.931813] env[70287]: INFO networking_nsxv3.common.synchronization [None req-65e59739-6777-4d75-ae73-3e56c0de85d5 tempest-ServersWithSpecificFlavorTestJSON-185056864 tempest-ServersWithSpecificFlavorTestJSON-185056864-project-member] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 581.932350] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 581.932687] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.932807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.246228] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 in Status: SUCCESS [ 582.246664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.247275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.249266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.249493] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.249798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.249798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.250298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.250298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.250298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.250298] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.305770] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.305912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.305990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.306247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.306332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.306432] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 already deleted. [ 582.306518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.306675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.306827] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.306908] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.601278] env[70287]: INFO networking_nsxv3.common.synchronization [req-d6cc324c-db01-485e-834d-971350dbc398 req-3bc14919-01c2-4720-b93b-57137838e623 tempest-DeleteServersAdminTestJSON-1239410168 tempest-DeleteServersAdminTestJSON-1239410168-project-member] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 582.601629] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 582.602225] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.602225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.602225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.602445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.602513] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.602621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.602755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.602837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.602960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.603019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.641389] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbadb315-bfe6-4947-b23f-861ec4456d95 in Status: SUCCESS [ 582.641677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.756721] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.757796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.758032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.758941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.758941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.758941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.758941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.758941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.758941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.758941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.759258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.759258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.759476] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.759567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.759644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.761390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.761390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.761390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.761390] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.830916] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.831119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.831119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.831338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.831429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.834803] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 already deleted. [ 582.834803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.110038] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.110038] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.110038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.110507] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 already deleted. [ 583.110507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.213264] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.213264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.213264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.213264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.215358] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.215753] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.215987] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.216333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.217041] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.217041] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 583.217161] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.217366] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.217556] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.219019] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 583.219019] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.219019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.238744] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.241962] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 583.241962] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.241962] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.241962] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-17705dd2-3b03-4840-96eb-c87348008bf8 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.241962] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.241962] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.241962] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.241962] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17705dd2-3b03-4840-96eb-c87348008bf8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.264403] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a071b3c-2494-4d97-804e-6e2eca010b22: rpc.has_security_group_logging(os_id): False [ 583.283036] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.283201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.283278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.283527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.283599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.283995] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.284169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.284267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.284473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.284588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.284802] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.284942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.285042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.285246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.285322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.285557] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.285677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.285785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.285966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.286102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.286234] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 is going to be created. [ 583.361745] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.361909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.361961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.362254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.362473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.372087] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 in Status: IN_PROGRESS for 2s [ 583.746763] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.747282] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.747381] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.749074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.749074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.749074] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 17705dd2-3b03-4840-96eb-c87348008bf8 not found, creating... [ 583.749074] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.749074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.749074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.749074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.749074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.749569] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.749812] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.750025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.751538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.751538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.751538] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 17705dd2-3b03-4840-96eb-c87348008bf8 is going to be created. [ 583.775434] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.775434] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.775434] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.775434] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.775434] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.775434] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.934150] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64eebc83-d0e6-4418-b651-efae0fdea09b in Status: SUCCESS [ 583.934443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.934639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.934863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.935076] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.935193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.935256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.935413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.935491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.935605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.935723] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.438878] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.944898] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64eebc83-d0e6-4418-b651-efae0fdea09b: rpc.has_security_group_logging(os_id): False [ 584.963031] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.963144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.963219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.963479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.963585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.963815] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.963941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.964029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.964242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.964347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.965384] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b is going to be created. [ 585.050524] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.050524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.050524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.050524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.050524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.073093] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64eebc83-d0e6-4418-b651-efae0fdea09b in Status: IN_PROGRESS for 2s [ 585.115461] env[70287]: INFO networking_nsxv3.common.synchronization [req-d6cc324c-db01-485e-834d-971350dbc398 req-18f995b1-6b7e-4a4f-8496-87b8f4f3a975 service nova] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_rules [ 585.115629] env[70287]: INFO networking_nsxv3.common.synchronization [req-d6cc324c-db01-485e-834d-971350dbc398 req-18f995b1-6b7e-4a4f-8496-87b8f4f3a975 service nova] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 585.115691] env[70287]: INFO networking_nsxv3.common.synchronization [req-d6cc324c-db01-485e-834d-971350dbc398 req-18f995b1-6b7e-4a4f-8496-87b8f4f3a975 service nova] Enqueued Resource ID: 17705dd2-3b03-4840-96eb-c87348008bf8 with Priority: HIGHEST for action port [ 585.116610] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_rules [ 585.116610] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 585.116610] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17705dd2-3b03-4840-96eb-c87348008bf8 with Priority: HIGHEST for action port [ 585.116840] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.116840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.116939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.119366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.119442] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.120910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.121130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.121209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.121403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.121604] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.121714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.121770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.122032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.122032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.122167] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.126201] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-17705dd2-3b03-4840-96eb-c87348008bf8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.126201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.126201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.126201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.126201] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17705dd2-3b03-4840-96eb-c87348008bf8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.344046] env[70287]: INFO networking_nsxv3.common.synchronization [req-525a078e-1301-4e8a-becf-9957db8041a2 req-24a38d62-87ba-4911-aa6d-cc2abc94ca14 tempest-ServersAdminNegativeTestJSON-1153260158 tempest-ServersAdminNegativeTestJSON-1153260158-project-member] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 585.345663] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 585.345663] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.345663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.345663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.345663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.345663] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.345663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.345663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.346109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.346109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.346109] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.385847] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 in Status: SUCCESS [ 585.385847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.621341] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.625271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.625525] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.626624] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17705dd2-3b03-4840-96eb-c87348008bf8 with status ACTIVE [ 585.626909] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.627047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.627129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.627356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.627398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.627572] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.627666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.627724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.627875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.627948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.628463] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.628569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.628675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.628882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.631657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.631657] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17705dd2-3b03-4840-96eb-c87348008bf8 is going to be updated. [ 585.664011] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.664011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.664011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.664393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.664543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.664967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17705dd2-3b03-4840-96eb-c87348008bf8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.801725] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.801725] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.801725] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.801985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.802671] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.802671] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.802671] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.802891] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.802979] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.803489] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.803489] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.803489] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.803664] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.803775] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 585.803808] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.803973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.824310] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.824536] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 585.824608] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.824882] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.825911] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-61ce3fba-99e4-4e03-9ee6-495ef83563d7 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.825911] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.826272] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.826671] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.827096] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61ce3fba-99e4-4e03-9ee6-495ef83563d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.850075] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.853422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.853422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.853422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.853422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.853606] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.853606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.853684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.855041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.855041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.855041] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 already deleted. [ 585.855041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.132057] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.333173] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.333434] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.333658] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.333806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.334022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.334269] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 61ce3fba-99e4-4e03-9ee6-495ef83563d7 not found, creating... [ 586.337757] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.337757] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.337757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.338272] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 61ce3fba-99e4-4e03-9ee6-495ef83563d7 is going to be created. [ 586.358738] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.359704] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.360176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.360176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.360411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.360630] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.634878] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.635143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.635714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.635963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.636076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.636183] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 is going to be created. [ 586.658760] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.658904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.661083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.661083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.661083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.668510] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: UNINITIALIZED for 2s [ 587.085224] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64eebc83-d0e6-4418-b651-efae0fdea09b in Status: SUCCESS [ 587.085224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.145525] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f95d1ea8-ce53-4b4e-8f55-48662c581b9c None None] Enqueued Resource ID: 1a26505e-6deb-4e20-b742-2c0c548230f5 with Priority: HIGHEST for action port [ 587.148888] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a26505e-6deb-4e20-b742-2c0c548230f5 with Priority: HIGHEST for action port [ 587.148888] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a26505e-6deb-4e20-b742-2c0c548230f5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.148888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a26505e-6deb-4e20-b742-2c0c548230f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.148888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a26505e-6deb-4e20-b742-2c0c548230f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.148888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a26505e-6deb-4e20-b742-2c0c548230f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.148888] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a26505e-6deb-4e20-b742-2c0c548230f5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.612978] env[70287]: INFO networking_nsxv3.common.synchronization [req-525a078e-1301-4e8a-becf-9957db8041a2 req-b896ab59-e81a-4d62-b78a-fc9f31551309 service nova] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_rules [ 587.613181] env[70287]: INFO networking_nsxv3.common.synchronization [req-525a078e-1301-4e8a-becf-9957db8041a2 req-b896ab59-e81a-4d62-b78a-fc9f31551309 service nova] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 587.613315] env[70287]: INFO networking_nsxv3.common.synchronization [req-525a078e-1301-4e8a-becf-9957db8041a2 req-b896ab59-e81a-4d62-b78a-fc9f31551309 service nova] Enqueued Resource ID: 61ce3fba-99e4-4e03-9ee6-495ef83563d7 with Priority: HIGHEST for action port [ 587.613551] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_rules [ 587.613684] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 587.613779] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61ce3fba-99e4-4e03-9ee6-495ef83563d7 with Priority: HIGHEST for action port [ 587.616672] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.616781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.616871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.619608] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.619608] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.619608] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.619608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.619608] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.621098] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-61ce3fba-99e4-4e03-9ee6-495ef83563d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.621098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.621098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.621098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.625388] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61ce3fba-99e4-4e03-9ee6-495ef83563d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.651863] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a26505e-6deb-4e20-b742-2c0c548230f5 [ 587.653221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.653221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.653221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.653221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.653221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.653221] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a26505e-6deb-4e20-b742-2c0c548230f5 already deleted. [ 587.653221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a26505e-6deb-4e20-b742-2c0c548230f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.073241] env[70287]: INFO networking_nsxv3.common.synchronization [req-86e6c5d3-7c63-46f1-a247-1e1297aa0c94 req-37eb8480-9cf0-4e70-b475-e80305709f16 tempest-ServersTestJSON-1206130467 tempest-ServersTestJSON-1206130467-project-member] Enqueued Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_members [ 588.075338] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_members [ 588.075890] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.078915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.078915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.078915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.078915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.078915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.078915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.078915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.078915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.078915] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.125899] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.127693] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.127693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.132780] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61ce3fba-99e4-4e03-9ee6-495ef83563d7 with status ACTIVE [ 588.132988] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.133240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.133240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.133412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.133504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.133689] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.133806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.133851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.134424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.134424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.134424] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.134424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.134654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.134654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.134654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.134735] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61ce3fba-99e4-4e03-9ee6-495ef83563d7 is going to be updated. [ 588.161570] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.161570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.161570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.162017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.162017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.162256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61ce3fba-99e4-4e03-9ee6-495ef83563d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.580623] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.581906] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.581906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.582316] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc already deleted. [ 588.582316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.629055] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.679540] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: SUCCESS [ 588.680291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.681037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.683140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.683140] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.683140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.683140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.683140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.683140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.683140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.683140] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.733149] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.733359] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-549" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.733678] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-549" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.734044] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-549" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.734345] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.734550] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.734670] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.734937] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.735097] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.735314] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 588.735419] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 588.735568] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 588.735626] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 588.735734] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 588.735838] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 588.736029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 588.757317] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 588.757629] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 588.757803] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 588.757870] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-549" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.758204] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-3a26c086-082d-452d-87a2-1f94bd04590b taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.758398] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.758525] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.758885] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.759062] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a26c086-082d-452d-87a2-1f94bd04590b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.133222] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.133222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.133222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.133222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.133222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.133222] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be created. [ 589.173627] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.174327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.176162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.176251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.176435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.186776] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: UNINITIALIZED for 2s [ 589.187181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.187342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.187538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.188493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.188493] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.188493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.188493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.188493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.188493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.188762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.188762] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.190861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.190938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.191245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.191374] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.191559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.191559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.191767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.191853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.191967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.192091] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.268168] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.268439] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.268563] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.268873] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.269524] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.269524] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 3a26c086-082d-452d-87a2-1f94bd04590b not found, creating... [ 589.269524] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.269722] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.269762] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.269984] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.270114] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.270536] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.270646] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.270688] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.270888] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.271055] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.271193] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 3a26c086-082d-452d-87a2-1f94bd04590b is going to be created. [ 589.291137] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.291354] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.291478] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.291892] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.292164] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.292382] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.369017] env[70287]: INFO networking_nsxv3.common.synchronization [None req-38beab42-d2a0-4fdc-9655-909945f9ea18 None None] Enqueued Resource ID: 0c8657f6-c504-42bf-a03a-eee931b3c380 with Priority: HIGHEST for action port [ 589.369017] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8657f6-c504-42bf-a03a-eee931b3c380 with Priority: HIGHEST for action port [ 589.369017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c8657f6-c504-42bf-a03a-eee931b3c380 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.369481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c8657f6-c504-42bf-a03a-eee931b3c380" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.369732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c8657f6-c504-42bf-a03a-eee931b3c380" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.370128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c8657f6-c504-42bf-a03a-eee931b3c380" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.370435] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c8657f6-c504-42bf-a03a-eee931b3c380',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.694875] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40: rpc.has_security_group_logging(os_id): False [ 589.717181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.717181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.717181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.717181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.717795] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.718331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.718610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.718822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.718941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.719913] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 is going to be created. [ 589.774555] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.774739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.774847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.775078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.775220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.786899] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: IN_PROGRESS for 2s [ 589.873526] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c8657f6-c504-42bf-a03a-eee931b3c380 [ 589.873857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.873970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.874025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.874252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.874337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.874430] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c8657f6-c504-42bf-a03a-eee931b3c380 already deleted. [ 589.874518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c8657f6-c504-42bf-a03a-eee931b3c380" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.062976] env[70287]: INFO networking_nsxv3.common.synchronization [None req-5b430799-62a6-4019-876e-0b40cce28d4b None None] Enqueued Resource ID: 3a60cb13-9095-4f8a-a5d2-d4e87053a0f7 with Priority: HIGHEST for action port [ 590.063211] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a60cb13-9095-4f8a-a5d2-d4e87053a0f7 with Priority: HIGHEST for action port [ 590.063837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a60cb13-9095-4f8a-a5d2-d4e87053a0f7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.063925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a60cb13-9095-4f8a-a5d2-d4e87053a0f7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.064028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a60cb13-9095-4f8a-a5d2-d4e87053a0f7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.066347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a60cb13-9095-4f8a-a5d2-d4e87053a0f7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.066422] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a60cb13-9095-4f8a-a5d2-d4e87053a0f7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.573035] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a60cb13-9095-4f8a-a5d2-d4e87053a0f7 [ 590.573439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.573439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.573439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.573625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.574225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.574225] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a60cb13-9095-4f8a-a5d2-d4e87053a0f7 already deleted. [ 590.574225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a60cb13-9095-4f8a-a5d2-d4e87053a0f7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.982508] env[70287]: INFO networking_nsxv3.common.synchronization [req-86e6c5d3-7c63-46f1-a247-1e1297aa0c94 req-25e6601b-8d18-4799-87c0-a6ff525d5df1 service nova] Enqueued Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_rules [ 590.982508] env[70287]: INFO networking_nsxv3.common.synchronization [req-86e6c5d3-7c63-46f1-a247-1e1297aa0c94 req-25e6601b-8d18-4799-87c0-a6ff525d5df1 service nova] Enqueued Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_members [ 590.982508] env[70287]: INFO networking_nsxv3.common.synchronization [req-86e6c5d3-7c63-46f1-a247-1e1297aa0c94 req-25e6601b-8d18-4799-87c0-a6ff525d5df1 service nova] Enqueued Resource ID: 3a26c086-082d-452d-87a2-1f94bd04590b with Priority: HIGHEST for action port [ 590.982508] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_rules [ 590.982508] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_members [ 590.982508] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a26c086-082d-452d-87a2-1f94bd04590b with Priority: HIGHEST for action port [ 590.983298] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.983298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.983713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.983713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.983713] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.985038] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.985162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.985200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.985389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.985547] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.986336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.986336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.986336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.986336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.986336] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.987331] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a26c086-082d-452d-87a2-1f94bd04590b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.987468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.987468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.987885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.987885] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a26c086-082d-452d-87a2-1f94bd04590b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.195702] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: SUCCESS [ 591.197454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.197630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.197874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.198089] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.198210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.198270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.198429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.198515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.198588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.198679] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.491251] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.494282] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.494282] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a26c086-082d-452d-87a2-1f94bd04590b with status ACTIVE [ 591.494282] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.494282] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.494282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.495483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.495776] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.495886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.496428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.496428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.496428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.496428] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a26c086-082d-452d-87a2-1f94bd04590b is going to be updated. [ 591.517857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.518594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.518594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.518594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.518805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.518805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a26c086-082d-452d-87a2-1f94bd04590b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.706172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.706512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.706512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.706618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708155] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.708155] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708155] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.708155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.708694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.708694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.708694] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.801576] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: SUCCESS [ 591.801938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.001340] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.089804] env[70287]: INFO networking_nsxv3.common.synchronization [None req-8267ba3c-d2ae-4044-b539-7a8a2e24afc9 None None] Enqueued Resource ID: 28e4cd10-b9ff-4780-9982-d2da6fed2092 with Priority: HIGHEST for action port [ 592.090171] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28e4cd10-b9ff-4780-9982-d2da6fed2092 with Priority: HIGHEST for action port [ 592.090917] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-28e4cd10-b9ff-4780-9982-d2da6fed2092 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.090917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28e4cd10-b9ff-4780-9982-d2da6fed2092" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.090917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28e4cd10-b9ff-4780-9982-d2da6fed2092" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.091206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28e4cd10-b9ff-4780-9982-d2da6fed2092" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.091206] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28e4cd10-b9ff-4780-9982-d2da6fed2092',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.211939] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6d080df-987c-42ee-a1c4-0bd34532e799: rpc.has_security_group_logging(os_id): False [ 592.229972] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.230129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.230188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.230395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.230482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.230696] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.230776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.231130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.231130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.231130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.231237] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.231328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.231386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.231531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.231672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.231980] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.231980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.231980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.233593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.234371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.234371] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be created. [ 592.289678] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.289872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.289944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.290279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.290380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.299605] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: IN_PROGRESS for 2s [ 592.505694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.505694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.505861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.506067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.506208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.506398] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc is going to be created. [ 592.530113] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.536187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.536187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.536187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.536187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.541915] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d31850-1f11-444e-b895-cf073f4e7ffc in Status: UNINITIALIZED for 2s [ 592.594472] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28e4cd10-b9ff-4780-9982-d2da6fed2092 [ 592.594761] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.595061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.595061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.595273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.595367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.595474] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28e4cd10-b9ff-4780-9982-d2da6fed2092 already deleted. [ 592.595568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28e4cd10-b9ff-4780-9982-d2da6fed2092" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.732048] env[70287]: INFO networking_nsxv3.common.synchronization [req-c3645edd-6f06-4d4f-a715-6c9d54fa56e0 req-a18cdd73-a9d8-403a-8552-3af2fea74748 tempest-ImagesNegativeTestJSON-1101893703 tempest-ImagesNegativeTestJSON-1101893703-project-member] Enqueued Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_members [ 592.732048] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGHEST for action security_group_members [ 592.732048] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.732048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.732048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.732048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.732048] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.732048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.732048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.732048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.732048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.735795] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.765492] env[70287]: INFO networking_nsxv3.common.synchronization [None req-8284c8cf-770a-48b1-8e94-26d684dcd9a7 None None] Enqueued Resource ID: c0b2981b-1472-4f3c-a23f-177ed2f3d379 with Priority: HIGHEST for action port [ 592.769870] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0b2981b-1472-4f3c-a23f-177ed2f3d379 with Priority: HIGHEST for action port [ 592.770944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0b2981b-1472-4f3c-a23f-177ed2f3d379 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.771094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0b2981b-1472-4f3c-a23f-177ed2f3d379" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.771230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0b2981b-1472-4f3c-a23f-177ed2f3d379" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.771783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0b2981b-1472-4f3c-a23f-177ed2f3d379" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.771783] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0b2981b-1472-4f3c-a23f-177ed2f3d379',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.238078] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.238735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.238735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.238735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.238735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.238910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.238910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.239022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.239122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.239289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.239289] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbadb315-bfe6-4947-b23f-861ec4456d95 is going to be updated. [ 593.276218] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0b2981b-1472-4f3c-a23f-177ed2f3d379 [ 593.276716] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.277053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.277295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.277639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.277822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.278130] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0b2981b-1472-4f3c-a23f-177ed2f3d379 already deleted. [ 593.278353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0b2981b-1472-4f3c-a23f-177ed2f3d379" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.300166] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.300768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.301430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.301844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.302245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.323881] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbadb315-bfe6-4947-b23f-861ec4456d95 in Status: IN_PROGRESS for 2s [ 593.848407] env[70287]: INFO networking_nsxv3.common.synchronization [None req-c3d12292-3b36-4025-883a-f96c4f1a46f2 None None] Enqueued Resource ID: f6026970-6b71-4ae4-9b8c-53ec45bc125c with Priority: HIGHEST for action port [ 593.848407] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6026970-6b71-4ae4-9b8c-53ec45bc125c with Priority: HIGHEST for action port [ 593.849545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6026970-6b71-4ae4-9b8c-53ec45bc125c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.850643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6026970-6b71-4ae4-9b8c-53ec45bc125c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.850798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6026970-6b71-4ae4-9b8c-53ec45bc125c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.851142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6026970-6b71-4ae4-9b8c-53ec45bc125c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.851262] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6026970-6b71-4ae4-9b8c-53ec45bc125c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.315554] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: SUCCESS [ 594.315554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.353390] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6026970-6b71-4ae4-9b8c-53ec45bc125c [ 594.353623] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.353768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.353831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.354081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.354171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.354261] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6026970-6b71-4ae4-9b8c-53ec45bc125c already deleted. [ 594.355017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6026970-6b71-4ae4-9b8c-53ec45bc125c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.551611] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d31850-1f11-444e-b895-cf073f4e7ffc in Status: SUCCESS [ 594.551957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.552230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.552488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.553300] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.553300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.553300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.553300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.553300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.553300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.553300] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.817560] env[70287]: INFO networking_nsxv3.common.synchronization [None req-e7a9aa01-1c3d-435a-8e7f-dfcbacfd0091 None None] Enqueued Resource ID: 7e46e2d4-027a-4ced-ace1-eca32c7285bc with Priority: HIGHEST for action port [ 594.817560] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e46e2d4-027a-4ced-ace1-eca32c7285bc with Priority: HIGHEST for action port [ 594.817560] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e46e2d4-027a-4ced-ace1-eca32c7285bc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.817560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e46e2d4-027a-4ced-ace1-eca32c7285bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.817560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e46e2d4-027a-4ced-ace1-eca32c7285bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.817845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e46e2d4-027a-4ced-ace1-eca32c7285bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.817845] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e46e2d4-027a-4ced-ace1-eca32c7285bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.057106] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.321944] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e46e2d4-027a-4ced-ace1-eca32c7285bc [ 595.322554] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.322554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.322554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.322818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.322818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.322926] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e46e2d4-027a-4ced-ace1-eca32c7285bc already deleted. [ 595.323054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e46e2d4-027a-4ced-ace1-eca32c7285bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.342792] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbadb315-bfe6-4947-b23f-861ec4456d95 in Status: SUCCESS [ 595.343137] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbadb315-bfe6-4947-b23f-861ec4456d95 deletion is rescheduled due to dependency. [ 595.343341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.561413] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 30d31850-1f11-444e-b895-cf073f4e7ffc: rpc.has_security_group_logging(os_id): False [ 595.580820] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.580820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.580820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.580820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.580820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.580820] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.580820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.580820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.581197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.581197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.581197] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc is going to be created. [ 595.669271] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.669271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.669271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.669271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.669271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.686455] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d31850-1f11-444e-b895-cf073f4e7ffc in Status: IN_PROGRESS for 2s [ 595.726246] env[70287]: INFO networking_nsxv3.common.synchronization [req-edb97c6d-bd03-42b3-868e-0ab78b21d9f8 req-35b91e9c-c481-43a7-aff7-d3326a5f3b16 tempest-MigrationsAdminTest-1148431189 tempest-MigrationsAdminTest-1148431189-project-member] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 595.726624] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 595.734224] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.734224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.734224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.734224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.734224] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.734224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.734224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.734224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.734224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.734224] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.944481] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d9d49caa-54da-44a5-9e3c-0eb3ef0eb8eb None None] Enqueued Resource ID: 527ddc8d-e2db-4caa-884e-dce506040b4f with Priority: HIGHEST for action port [ 595.944481] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 527ddc8d-e2db-4caa-884e-dce506040b4f with Priority: HIGHEST for action port [ 595.945270] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-527ddc8d-e2db-4caa-884e-dce506040b4f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.945489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-527ddc8d-e2db-4caa-884e-dce506040b4f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.945489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-527ddc8d-e2db-4caa-884e-dce506040b4f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.946118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-527ddc8d-e2db-4caa-884e-dce506040b4f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.946118] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('527ddc8d-e2db-4caa-884e-dce506040b4f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.233874] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.234251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.234251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.234675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.234675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.234675] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.234852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.234852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.234921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.234982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.235078] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 already deleted. [ 596.235157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.301020] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.301268] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.301394] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.301726] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.302465] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.302845] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.302913] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.303191] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.303410] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.303664] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 596.303908] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.304479] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.304676] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.304839] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 596.305101] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.305171] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.331741] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.331741] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 596.331741] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.331741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.331741] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-9a29065a-6229-4c54-9295-a5727a9f5a16 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.331741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.331741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.331741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.331741] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a29065a-6229-4c54-9295-a5727a9f5a16',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.448510] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 527ddc8d-e2db-4caa-884e-dce506040b4f [ 596.448739] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.448876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.448942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.449173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.449260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.449355] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:527ddc8d-e2db-4caa-884e-dce506040b4f already deleted. [ 596.449432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-527ddc8d-e2db-4caa-884e-dce506040b4f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.836037] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.836292] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.836424] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.836715] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.836861] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.837109] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 9a29065a-6229-4c54-9295-a5727a9f5a16 not found, creating... [ 596.837300] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.837460] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.837850] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.837850] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.837991] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.838232] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.838382] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.838498] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.838704] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.838872] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.838979] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 9a29065a-6229-4c54-9295-a5727a9f5a16 is going to be created. [ 596.864198] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.864198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.864198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.864198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.866209] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.867016] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.512016] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d447d692-f476-42cf-b207-d3aa1d44e033 None None] Enqueued Resource ID: eacf4a9b-8dd8-41fb-bee4-3e881ca2824d with Priority: HIGHEST for action port [ 597.512342] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eacf4a9b-8dd8-41fb-bee4-3e881ca2824d with Priority: HIGHEST for action port [ 597.512876] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-eacf4a9b-8dd8-41fb-bee4-3e881ca2824d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.513152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eacf4a9b-8dd8-41fb-bee4-3e881ca2824d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.513152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eacf4a9b-8dd8-41fb-bee4-3e881ca2824d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.513450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eacf4a9b-8dd8-41fb-bee4-3e881ca2824d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.513560] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eacf4a9b-8dd8-41fb-bee4-3e881ca2824d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.686622] env[70287]: INFO networking_nsxv3.common.synchronization [None req-6751288f-43c7-4de7-9176-0629f2d76668 None None] Enqueued Resource ID: 156b4fd1-5216-4b93-b99c-898584043268 with Priority: HIGHEST for action port [ 597.687788] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 156b4fd1-5216-4b93-b99c-898584043268 with Priority: HIGHEST for action port [ 597.689120] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-156b4fd1-5216-4b93-b99c-898584043268 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.689120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-156b4fd1-5216-4b93-b99c-898584043268" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.689258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-156b4fd1-5216-4b93-b99c-898584043268" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.689626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-156b4fd1-5216-4b93-b99c-898584043268" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.689626] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('156b4fd1-5216-4b93-b99c-898584043268',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.702147] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 30d31850-1f11-444e-b895-cf073f4e7ffc in Status: SUCCESS [ 597.702431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.019643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eacf4a9b-8dd8-41fb-bee4-3e881ca2824d [ 598.019643] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.019643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.019643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.019643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.019643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.019643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eacf4a9b-8dd8-41fb-bee4-3e881ca2824d already deleted. [ 598.019643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eacf4a9b-8dd8-41fb-bee4-3e881ca2824d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.117388] env[70287]: INFO networking_nsxv3.common.synchronization [None req-93b99115-a3b2-45e9-9d9f-29a7a804c1ee None None] Enqueued Resource ID: 828b274c-73b6-4fd3-8b58-18239616b074 with Priority: HIGHEST for action port [ 598.118135] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 828b274c-73b6-4fd3-8b58-18239616b074 with Priority: HIGHEST for action port [ 598.118282] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-828b274c-73b6-4fd3-8b58-18239616b074 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.118404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-828b274c-73b6-4fd3-8b58-18239616b074" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.118468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-828b274c-73b6-4fd3-8b58-18239616b074" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.118714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-828b274c-73b6-4fd3-8b58-18239616b074" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.118793] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('828b274c-73b6-4fd3-8b58-18239616b074',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.192225] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 156b4fd1-5216-4b93-b99c-898584043268 [ 598.192507] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.193365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.193462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.193651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.193767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.193892] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:156b4fd1-5216-4b93-b99c-898584043268 already deleted. [ 598.193990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-156b4fd1-5216-4b93-b99c-898584043268" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.625705] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 828b274c-73b6-4fd3-8b58-18239616b074 [ 598.625705] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.625705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.625705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.625705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.625705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.625705] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:828b274c-73b6-4fd3-8b58-18239616b074 already deleted. [ 598.625705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-828b274c-73b6-4fd3-8b58-18239616b074" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.861431] env[70287]: INFO networking_nsxv3.common.synchronization [req-7b50c998-779b-4731-aba0-e60b8d246690 req-0777815d-f2ea-4ab2-8639-8d02191128a0 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 598.862130] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 598.862599] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.862599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.862835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.863049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.863326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.863530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.863657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.864198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.864295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.864477] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.024337] env[70287]: INFO networking_nsxv3.common.synchronization [req-edb97c6d-bd03-42b3-868e-0ab78b21d9f8 req-fb960df1-5378-4850-a1e3-400780706a3d service nova] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_rules [ 599.024564] env[70287]: INFO networking_nsxv3.common.synchronization [req-edb97c6d-bd03-42b3-868e-0ab78b21d9f8 req-fb960df1-5378-4850-a1e3-400780706a3d service nova] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 599.024706] env[70287]: INFO networking_nsxv3.common.synchronization [req-edb97c6d-bd03-42b3-868e-0ab78b21d9f8 req-fb960df1-5378-4850-a1e3-400780706a3d service nova] Enqueued Resource ID: 9a29065a-6229-4c54-9295-a5727a9f5a16 with Priority: HIGHEST for action port [ 599.025234] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_rules [ 599.025366] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 599.025461] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a29065a-6229-4c54-9295-a5727a9f5a16 with Priority: HIGHEST for action port [ 599.026240] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.026429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.026531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.026826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.027292] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.028100] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.028278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.028479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.031830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.031830] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.031830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a29065a-6229-4c54-9295-a5727a9f5a16 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.031830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.031830] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a29065a-6229-4c54-9295-a5727a9f5a16',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.367263] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.367263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.367263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.367263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.367263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.367698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.367698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.367698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.367822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.367822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.367886] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 already deleted. [ 599.367986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.533360] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.535233] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.535377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.535514] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a29065a-6229-4c54-9295-a5727a9f5a16 with status ACTIVE [ 599.535670] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.535773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.535835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.536033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.536124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.536290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.536385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.536443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.536590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.536666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.536835] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.536924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.536981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.537775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.537910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.537973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a29065a-6229-4c54-9295-a5727a9f5a16 is going to be updated. [ 599.561071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.561261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.561261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.561543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.561620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.561791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a29065a-6229-4c54-9295-a5727a9f5a16" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.679341] env[70287]: INFO networking_nsxv3.common.synchronization [req-58ca0df7-980e-4b8c-864c-19b3d0afc727 req-11e640e5-8ad2-49c6-8be7-19764e8778ff tempest-TenantUsagesTestJSON-1250854354 tempest-TenantUsagesTestJSON-1250854354-project-member] Enqueued Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_members [ 599.680221] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGHEST for action security_group_members [ 599.680644] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.680743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.681129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.681178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.681924] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.681924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.681924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.681924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.682122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.682154] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.860906] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.861117] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.861241] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.861587] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.861876] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.862066] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.862183] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.862407] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.863355] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.863355] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.863355] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.863355] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.863355] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.863355] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 599.863355] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.863692] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.892854] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.896024] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 599.896024] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.896024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.896024] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-9ba795bf-ce47-4389-b155-f6a578968901 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.896024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.896024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.896024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.896024] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ba795bf-ce47-4389-b155-f6a578968901',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.036099] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.184401] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.184658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.184742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.184948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.185047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.185262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.185379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.185454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.185600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.185679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.185775] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bd48e89-cc58-4469-862d-723098d8ef49 is going to be updated. [ 600.241341] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.241549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.241549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.241859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.241977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.252361] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bd48e89-cc58-4469-862d-723098d8ef49 in Status: IN_PROGRESS for 2s [ 600.400352] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.400572] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.400717] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.404689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.404689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.404689] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 9ba795bf-ce47-4389-b155-f6a578968901 not found, creating... [ 600.405021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.405021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.405189] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.405573] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.405674] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.406312] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.406645] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.406645] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.407971] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.407971] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.407971] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 9ba795bf-ce47-4389-b155-f6a578968901 is going to be created. [ 600.428932] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.429735] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.429865] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.430164] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.430390] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.430885] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.538626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.539444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.539444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.539444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.539444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.539737] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be created. [ 600.569045] env[70287]: INFO networking_nsxv3.common.synchronization [req-22883815-f040-4629-9c7e-47391b372ae0 req-ebee9f9d-1caf-4ced-8bd0-e55da294adc0 tempest-VolumesAdminNegativeTest-1117785024 tempest-VolumesAdminNegativeTest-1117785024-project-member] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_members [ 600.569045] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_members [ 600.569045] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.569045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.569045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.569045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.569045] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.569045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.569045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.569045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.569045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.569045] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.591133] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.591366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.591464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.591818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.592072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.608239] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: UNINITIALIZED for 2s [ 601.073579] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.074875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.074875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.074875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.074875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.074875] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.074875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.074875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.077243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.077243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.077243] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 already deleted. [ 601.077243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.230498] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.234190] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.234190] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.234190] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.234190] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.234190] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.234190] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.237133] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.237133] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.237133] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 601.237133] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.237133] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.237133] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.237133] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 601.237133] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.237133] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.259331] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.259491] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 601.259628] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.259840] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.260813] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.260813] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.260813] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.260813] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.261189] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.331487] env[70287]: INFO networking_nsxv3.common.synchronization [req-7b50c998-779b-4731-aba0-e60b8d246690 req-6ed9a694-ef21-4133-8d24-dbb36ae65be7 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 601.331487] env[70287]: INFO networking_nsxv3.common.synchronization [req-7b50c998-779b-4731-aba0-e60b8d246690 req-6ed9a694-ef21-4133-8d24-dbb36ae65be7 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 601.331487] env[70287]: INFO networking_nsxv3.common.synchronization [req-7b50c998-779b-4731-aba0-e60b8d246690 req-6ed9a694-ef21-4133-8d24-dbb36ae65be7 service nova] Enqueued Resource ID: 9ba795bf-ce47-4389-b155-f6a578968901 with Priority: HIGHEST for action port [ 601.331487] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 601.331487] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 601.331487] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ba795bf-ce47-4389-b155-f6a578968901 with Priority: HIGHEST for action port [ 601.331487] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.331487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.331487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.331487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.331487] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.332155] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.332244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.332244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.332485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.332662] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.333187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.333187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.333187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.333187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.333362] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.334254] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ba795bf-ce47-4389-b155-f6a578968901 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.334397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.334443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.334575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.334648] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ba795bf-ce47-4389-b155-f6a578968901',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.506906] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9b20ab78-92eb-470a-b76d-4120f99968fe None None] Enqueued Resource ID: 80480b8c-6b65-4c4b-92e0-77586830259c with Priority: HIGHEST for action port [ 601.507186] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80480b8c-6b65-4c4b-92e0-77586830259c with Priority: HIGHEST for action port [ 601.507743] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-80480b8c-6b65-4c4b-92e0-77586830259c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.507872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80480b8c-6b65-4c4b-92e0-77586830259c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.507950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80480b8c-6b65-4c4b-92e0-77586830259c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.508201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80480b8c-6b65-4c4b-92e0-77586830259c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.508283] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80480b8c-6b65-4c4b-92e0-77586830259c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.620037] env[70287]: INFO networking_nsxv3.common.synchronization [None req-33148cd8-565a-45fd-acf6-9bc200fa0305 None None] Enqueued Resource ID: e9dd53d9-9f2f-4004-930b-f272170ad67d with Priority: HIGHEST for action port [ 601.620037] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9dd53d9-9f2f-4004-930b-f272170ad67d with Priority: HIGHEST for action port [ 601.620037] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9dd53d9-9f2f-4004-930b-f272170ad67d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.620037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9dd53d9-9f2f-4004-930b-f272170ad67d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.620037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9dd53d9-9f2f-4004-930b-f272170ad67d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.620037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9dd53d9-9f2f-4004-930b-f272170ad67d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.620037] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9dd53d9-9f2f-4004-930b-f272170ad67d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.768624] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.768624] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.768624] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.768899] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.769429] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.769429] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e not found, creating... [ 601.769522] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.769885] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.769885] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.770104] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.770257] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.770471] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.770682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.770806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.771384] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.774042] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.774042] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e is going to be created. [ 601.783125] env[70287]: INFO networking_nsxv3.common.synchronization [None req-924b1818-76a3-4424-9fe4-7fc975a8c742 None None] Enqueued Resource ID: f99e62a2-30ba-42ea-b95d-25ea79d84dd2 with Priority: HIGHEST for action port [ 601.783125] env[70287]: INFO networking_nsxv3.common.synchronization [None req-5bf665d1-709c-453c-abf9-e8725d86b4e4 None None] Enqueued Resource ID: 12a6e1a9-4655-4069-99ea-d508b0adb8da with Priority: HIGHEST for action port [ 601.783125] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f99e62a2-30ba-42ea-b95d-25ea79d84dd2 with Priority: HIGHEST for action port [ 601.783125] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a6e1a9-4655-4069-99ea-d508b0adb8da with Priority: HIGHEST for action port [ 601.783125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f99e62a2-30ba-42ea-b95d-25ea79d84dd2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.783125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f99e62a2-30ba-42ea-b95d-25ea79d84dd2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.783125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f99e62a2-30ba-42ea-b95d-25ea79d84dd2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.783125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f99e62a2-30ba-42ea-b95d-25ea79d84dd2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.783125] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f99e62a2-30ba-42ea-b95d-25ea79d84dd2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.785510] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a6e1a9-4655-4069-99ea-d508b0adb8da taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.785510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a6e1a9-4655-4069-99ea-d508b0adb8da" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.785510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a6e1a9-4655-4069-99ea-d508b0adb8da" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.785510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a6e1a9-4655-4069-99ea-d508b0adb8da" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.788586] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a6e1a9-4655-4069-99ea-d508b0adb8da',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.794787] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.795674] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.795825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.796188] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.798836] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.798836] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.839230] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.841660] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.841867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.842022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9ba795bf-ce47-4389-b155-f6a578968901 with status ACTIVE [ 601.842214] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.842291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.842351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.842822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.842822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.842822] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.843034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.843034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.843434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.843648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.843862] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.844997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.844997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.844997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.844997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.844997] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9ba795bf-ce47-4389-b155-f6a578968901 is going to be updated. [ 601.878095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.878351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.878422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.878654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.878811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.879031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ba795bf-ce47-4389-b155-f6a578968901" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.011052] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80480b8c-6b65-4c4b-92e0-77586830259c [ 602.011279] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.011416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.011482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.012669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.012669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.012669] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80480b8c-6b65-4c4b-92e0-77586830259c already deleted. [ 602.012669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80480b8c-6b65-4c4b-92e0-77586830259c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.123212] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9dd53d9-9f2f-4004-930b-f272170ad67d [ 602.123860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.123860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.124030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.124163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.124230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.124330] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9dd53d9-9f2f-4004-930b-f272170ad67d already deleted. [ 602.124411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9dd53d9-9f2f-4004-930b-f272170ad67d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.191498] env[70287]: INFO networking_nsxv3.common.synchronization [None req-0c674958-10eb-4937-b275-de4e881616e5 None None] Enqueued Resource ID: 58961362-c437-4b4f-b3d7-1c0783505995 with Priority: HIGHEST for action port [ 602.191637] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58961362-c437-4b4f-b3d7-1c0783505995 with Priority: HIGHEST for action port [ 602.192725] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-58961362-c437-4b4f-b3d7-1c0783505995 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.192725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-58961362-c437-4b4f-b3d7-1c0783505995" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.192725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-58961362-c437-4b4f-b3d7-1c0783505995" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.193354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-58961362-c437-4b4f-b3d7-1c0783505995" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.193527] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('58961362-c437-4b4f-b3d7-1c0783505995',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.261387] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1bd48e89-cc58-4469-862d-723098d8ef49 in Status: SUCCESS [ 602.261549] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1bd48e89-cc58-4469-862d-723098d8ef49 deletion is rescheduled due to dependency. [ 602.261660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.284671] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f99e62a2-30ba-42ea-b95d-25ea79d84dd2 [ 602.284937] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.285077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.285189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.285614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.285706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.285801] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f99e62a2-30ba-42ea-b95d-25ea79d84dd2 already deleted. [ 602.285884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f99e62a2-30ba-42ea-b95d-25ea79d84dd2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.291295] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12a6e1a9-4655-4069-99ea-d508b0adb8da [ 602.291500] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.291649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.291684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.291915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.292042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.292099] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12a6e1a9-4655-4069-99ea-d508b0adb8da already deleted. [ 602.292177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a6e1a9-4655-4069-99ea-d508b0adb8da" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.342111] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.617844] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: SUCCESS [ 602.618125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.618696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.618927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.619166] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.619304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.619381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.619578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.619658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.619836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.619945] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.696304] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 58961362-c437-4b4f-b3d7-1c0783505995 [ 602.696553] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.696700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.696786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.697057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.697166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.697233] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:58961362-c437-4b4f-b3d7-1c0783505995 already deleted. [ 602.697299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-58961362-c437-4b4f-b3d7-1c0783505995" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.846197] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.846373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.846449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.846647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.846809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.846886] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be created. [ 602.870920] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.871110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.871861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.872354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.872695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.886807] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: UNINITIALIZED for 2s [ 603.004044] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9770664f-0f0c-47f7-b44f-c25a60217992 tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 603.004044] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 603.004321] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.004587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.004587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.004786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.004887] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.122267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.122479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.122584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.122884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.123132] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.125720] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.125720] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.125720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.125720] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.234733] env[70287]: INFO networking_nsxv3.common.synchronization [req-22883815-f040-4629-9c7e-47391b372ae0 req-baccd857-04f2-4432-b06e-f42c534fe2c4 service nova] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_rules [ 603.234921] env[70287]: INFO networking_nsxv3.common.synchronization [req-22883815-f040-4629-9c7e-47391b372ae0 req-baccd857-04f2-4432-b06e-f42c534fe2c4 service nova] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_members [ 603.235059] env[70287]: INFO networking_nsxv3.common.synchronization [req-22883815-f040-4629-9c7e-47391b372ae0 req-baccd857-04f2-4432-b06e-f42c534fe2c4 service nova] Enqueued Resource ID: 05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e with Priority: HIGHEST for action port [ 603.235396] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_rules [ 603.235443] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_members [ 603.235510] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e with Priority: HIGHEST for action port [ 603.238323] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.238500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.238561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.238769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.238856] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.239864] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.239988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.240087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.243069] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.243069] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.243069] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.243069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.243069] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.363115] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea7a7abb-8132-4343-98b0-ff0606afa5e1 req-b0ee9564-d1c4-4c1e-b9fc-fed7ac48e2ff tempest-VolumesAssistedSnapshotsTest-104473246 tempest-VolumesAssistedSnapshotsTest-104473246-project-member] Enqueued Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_members [ 603.365529] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_members [ 603.365529] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.365529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.365529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.365529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.365529] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.365529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.365529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.365529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.365529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.366067] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.414244] env[70287]: INFO networking_nsxv3.common.synchronization [None req-e5cc4cd1-e50c-4fd4-bd99-91f322c0e119 tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 603.414840] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 603.415163] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.415271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.527236] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.527236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.528175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.528814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.528814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.528814] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a already deleted. [ 603.528814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.528814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.529153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.529153] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.628161] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df66c1e2-6914-41c1-a5ac-eb133438cab6: rpc.has_security_group_logging(os_id): False [ 603.645810] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.646030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.646030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.646271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.646346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.646731] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.646731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.646731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.646905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.646905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.648255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.648255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.648255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.652051] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be created. [ 603.715396] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.715396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.715396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.715396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.715396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.724019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: IN_PROGRESS for 2s [ 603.749427] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.749427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.749427] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.750104] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e with status ACTIVE [ 603.750369] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.750719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.750923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.751900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.752054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.755142] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.755142] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.755142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.755142] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e is going to be updated. [ 603.774507] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.774680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.774781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.775011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.775187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.775591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05ae4cdb-fce0-48a1-9d9b-840dac2c4f1e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.868187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.868454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.868512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.868821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.868971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.869269] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.869408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.869531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.869839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.869888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.869991] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 already deleted. [ 603.870187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.982884] env[70287]: INFO networking_nsxv3.common.synchronization [None req-e89d8ba9-4e41-4aaa-b86e-8c928db655fa tempest-ServersTestFqdnHostnames-222205351 tempest-ServersTestFqdnHostnames-222205351-project-member] Enqueued Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_rules [ 603.983537] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_rules [ 603.983864] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e268cb7c-d939-4cae-9df0-54709ed24656 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.984018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.984689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.985839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.985904] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.052705] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.052705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.052705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.052705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.052705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.052705] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a already deleted. [ 604.052705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.256198] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.417728] env[70287]: INFO networking_nsxv3.common.synchronization [None req-3f055b44-75f1-402d-a9e5-ef5bdf527b21 tempest-ServersTestFqdnHostnames-222205351 tempest-ServersTestFqdnHostnames-222205351-project-member] Enqueued Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_rules [ 604.418403] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_rules [ 604.418683] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e268cb7c-d939-4cae-9df0-54709ed24656 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.418789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.505259] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.505402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.505474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.505699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.505794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.505915] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e268cb7c-d939-4cae-9df0-54709ed24656 already deleted. [ 604.506031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.506311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.506394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.506432] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.613533] env[70287]: INFO networking_nsxv3.common.synchronization [req-e97fd712-75b3-4331-96ee-ad617b84fd57 req-a62509df-41ca-4745-8849-d0a80b96fd78 tempest-ServerExternalEventsTest-948524789 tempest-ServerExternalEventsTest-948524789-project-member] Enqueued Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_members [ 604.614956] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGHEST for action security_group_members [ 604.615975] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f9f7411-4b44-4b2b-aafd-f6a4aab64866 req-420fe564-fbef-478c-8977-7d739bfabbab tempest-DeleteServersAdminTestJSON-1453917605 tempest-DeleteServersAdminTestJSON-1453917605-project-admin] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 604.616343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.616558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.616708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.617091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.617179] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.617316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.617499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.617865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.618590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.618590] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.619597] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 604.620200] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.620352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.620441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.620644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.620854] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.621009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.621109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.621288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.621417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.621538] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.685333] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-752 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.685333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-752" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.685333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-752" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.685333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-752" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.685526] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.685588] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.685660] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.685884] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.686240] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.687179] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.687745] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.687964] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.688137] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.688309] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 604.688465] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.689057] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.707693] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.707943] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 604.708164] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.708413] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-752" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.708793] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-c2ff246d-cae5-4654-ab72-a45acb421027 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.709074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.709691] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.709691] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.709878] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2ff246d-cae5-4654-ab72-a45acb421027',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.758751] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.758931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.759010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.759226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.759348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.759410] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 is going to be created. [ 604.781413] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.782146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.782146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.782146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.782146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.792177] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: UNINITIALIZED for 2s [ 604.898357] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 604.898659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.898871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.899137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.899397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.899665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.899665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.899847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.899938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.900109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.900241] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.027032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.027032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.027032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.027032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.027032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.027032] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e268cb7c-d939-4cae-9df0-54709ed24656 already deleted. [ 605.027032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.121303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.121303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.121464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.121571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.121676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.122110] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.122248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.122318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.122497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.122580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.122701] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 is going to be updated. [ 605.123938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.124086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.124168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.124360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.124451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.124659] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.124760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.124823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.124993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.125091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.125197] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 is going to be updated. [ 605.152615] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.156602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.156602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.156602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.156602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.160226] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.160415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.160415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.160633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.161382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.171074] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 in Status: IN_PROGRESS for 2s [ 605.175269] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: IN_PROGRESS for 2s [ 605.213175] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.214151] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.214151] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.215250] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.215444] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.215600] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port c2ff246d-cae5-4654-ab72-a45acb421027 not found, creating... [ 605.215945] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.216416] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.216416] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.218034] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.218034] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.218435] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.218603] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.218729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.218983] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.219351] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.219806] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: c2ff246d-cae5-4654-ab72-a45acb421027 is going to be created. [ 605.249707] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.250062] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.250276] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.250675] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.251084] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.251286] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.402562] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.403771] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.403771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.405211] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.405211] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.405211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.405211] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.730444] env[70287]: INFO networking_nsxv3.common.synchronization [req-4d430b44-8bf0-4a4d-9924-917905fa4764 req-4e1cd197-07ba-4a66-8cd9-2592ccb500c5 tempest-ServersWithSpecificFlavorTestJSON-185056864 tempest-ServersWithSpecificFlavorTestJSON-185056864-project-member] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 605.730921] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 605.731814] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.731946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.733747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.734111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.734349] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.734609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.734609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.734710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.734799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.734927] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.741426] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: SUCCESS [ 605.741563] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.907242] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 605.924762] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.925174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.927032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.927032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.927032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.928255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.928500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.928689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.928942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.930568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.932250] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be created. [ 605.987284] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.987368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.987471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.987660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.987845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.998438] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 606.239137] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.239396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.239508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.239768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.239878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.240079] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.240174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.240570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.240570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.240570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.240570] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 already deleted. [ 606.240765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.302343] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.302552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.302677] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.303096] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.303388] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.303637] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.303720] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.303899] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.304056] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.304297] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.304413] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.304641] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.304641] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.304894] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 606.304894] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.305299] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.324022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.324022] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 606.324414] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.324414] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.324612] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.324794] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.324914] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.325294] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.325514] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62973aa0-57a0-4bb9-a5f1-390b20cbb72b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.643412] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea7a7abb-8132-4343-98b0-ff0606afa5e1 req-e7c788b9-82ff-471f-acd7-bb8407f296aa service nova] Enqueued Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_rules [ 606.643685] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea7a7abb-8132-4343-98b0-ff0606afa5e1 req-e7c788b9-82ff-471f-acd7-bb8407f296aa service nova] Enqueued Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_members [ 606.643733] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea7a7abb-8132-4343-98b0-ff0606afa5e1 req-e7c788b9-82ff-471f-acd7-bb8407f296aa service nova] Enqueued Resource ID: c2ff246d-cae5-4654-ab72-a45acb421027 with Priority: HIGHEST for action port [ 606.644294] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_rules [ 606.644430] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_members [ 606.644527] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2ff246d-cae5-4654-ab72-a45acb421027 with Priority: HIGHEST for action port [ 606.644804] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.644935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.644999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.645213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.645296] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.646284] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.646284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.646395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.647488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.647488] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.647488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.647488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.647488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.647488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.647488] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.647882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2ff246d-cae5-4654-ab72-a45acb421027 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.647979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.647979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.648146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.648221] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2ff246d-cae5-4654-ab72-a45acb421027',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.804034] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: SUCCESS [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.804034] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.804034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.804034] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.828800] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.828999] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.828999] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.829522] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.829522] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.829679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 62973aa0-57a0-4bb9-a5f1-390b20cbb72b not found, creating... [ 606.830729] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.830729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.830729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.830729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.830729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.830982] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.831120] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.831280] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.831515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.831943] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.831943] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 62973aa0-57a0-4bb9-a5f1-390b20cbb72b is going to be created. [ 606.853091] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.853343] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.853475] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.853796] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.855416] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.856137] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.964263] env[70287]: INFO networking_nsxv3.common.synchronization [None req-70c00d7f-4f59-432c-90a0-36d172886a8f tempest-ServersTestManualDisk-1622628182 tempest-ServersTestManualDisk-1622628182-project-member] Enqueued Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_rules [ 606.964263] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_rules [ 606.965203] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.965380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.965561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.966075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.966418] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.077505] env[70287]: INFO networking_nsxv3.common.synchronization [None req-98845753-15f6-44f6-8182-f23e7e00e5b7 tempest-ServersV294TestFqdnHostnames-340574857 tempest-ServersV294TestFqdnHostnames-340574857-project-member] Enqueued Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_rules [ 607.077625] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_rules [ 607.077837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.078051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.078377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.078917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.079047] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.150015] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.151017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.151497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.151583] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2ff246d-cae5-4654-ab72-a45acb421027 with status ACTIVE [ 607.151696] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.151975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.152142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.152625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.152625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.152937] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.153170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.153170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.153503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.153602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.153767] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.153898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.153966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.154361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.154361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.154525] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2ff246d-cae5-4654-ab72-a45acb421027 is going to be updated. [ 607.173949] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.174119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.174866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.175269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.175269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.175434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2ff246d-cae5-4654-ab72-a45acb421027" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.188149] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 in Status: SUCCESS [ 607.188273] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 deletion is rescheduled due to dependency. [ 607.188528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.189482] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: SUCCESS [ 607.189627] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 deletion is rescheduled due to dependency. [ 607.189882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.204366] env[70287]: INFO networking_nsxv3.common.synchronization [None req-11319673-2044-47ff-b51d-880eab47797b tempest-ServersTestManualDisk-1622628182 tempest-ServersTestManualDisk-1622628182-project-member] Enqueued Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_rules [ 607.204629] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_rules [ 607.205168] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.205377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.279050] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9eca39d5-fb8e-493f-bf51-0e23554d7c10 None None] Enqueued Resource ID: e90a96a8-3c6f-4829-81c1-6284799f4645 with Priority: HIGHEST for action port [ 607.279314] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e90a96a8-3c6f-4829-81c1-6284799f4645 with Priority: HIGHEST for action port [ 607.279870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e90a96a8-3c6f-4829-81c1-6284799f4645 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.280611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e90a96a8-3c6f-4829-81c1-6284799f4645" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.280705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e90a96a8-3c6f-4829-81c1-6284799f4645" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.280912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e90a96a8-3c6f-4829-81c1-6284799f4645" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.281963] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e90a96a8-3c6f-4829-81c1-6284799f4645',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.306952] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.312478] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fd0ed1e3-cebc-4c50-9779-056e04e3b10c tempest-ServersV294TestFqdnHostnames-340574857 tempest-ServersV294TestFqdnHostnames-340574857-project-member] Enqueued Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_rules [ 607.316041] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_rules [ 607.316041] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.316041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.486898] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.486898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.486898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.486898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.486898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.486898] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 already deleted. [ 607.486898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.487194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.487194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.487194] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.597627] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.597627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.597796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.597889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.598079] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.598194] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a already deleted. [ 607.598299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.598470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.598663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.598782] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.656696] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.789392] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e90a96a8-3c6f-4829-81c1-6284799f4645 [ 607.789744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.789926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.790010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.790257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.790369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.790453] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e90a96a8-3c6f-4829-81c1-6284799f4645 already deleted. [ 607.790543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e90a96a8-3c6f-4829-81c1-6284799f4645" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.813406] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96287f57-8a87-4086-ac4e-214b416b0677: rpc.has_security_group_logging(os_id): False [ 607.831882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.831882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.831882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.831882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.831882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.832351] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.832351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.832351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.832525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.832525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.832625] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 is going to be created. [ 607.839736] env[70287]: INFO networking_nsxv3.common.synchronization [None req-12c54182-d2f1-491b-ba50-f17a1557c852 None None] Enqueued Resource ID: 5f743a33-040c-4203-a6ae-3421f862aa22 with Priority: HIGHEST for action port [ 607.840052] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f743a33-040c-4203-a6ae-3421f862aa22 with Priority: HIGHEST for action port [ 607.840660] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f743a33-040c-4203-a6ae-3421f862aa22 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.840790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f743a33-040c-4203-a6ae-3421f862aa22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.840872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f743a33-040c-4203-a6ae-3421f862aa22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.841129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f743a33-040c-4203-a6ae-3421f862aa22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.841223] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f743a33-040c-4203-a6ae-3421f862aa22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.889530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.889530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.889530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.890276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.890276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.917944] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: IN_PROGRESS for 2s [ 608.015340] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.015600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.016674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.016974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.017090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.017199] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 already deleted. [ 608.017300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.018419] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 608.018647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.120486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.120486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.120486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.120764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.120764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.120945] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a already deleted. [ 608.120945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.160441] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.160621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.160673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.160892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.160985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.161096] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 is going to be created. [ 608.183885] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.183885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.184071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.184365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.184592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.193821] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 in Status: UNINITIALIZED for 2s [ 608.332041] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fa38fb37-c1c2-4f11-be92-50ca8f82e6b3 None None] Enqueued Resource ID: 136180c5-94a2-4852-8afe-15e5f49b5532 with Priority: HIGHEST for action port [ 608.332361] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 136180c5-94a2-4852-8afe-15e5f49b5532 with Priority: HIGHEST for action port [ 608.332431] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-136180c5-94a2-4852-8afe-15e5f49b5532 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.332826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-136180c5-94a2-4852-8afe-15e5f49b5532" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.332826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-136180c5-94a2-4852-8afe-15e5f49b5532" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.332826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-136180c5-94a2-4852-8afe-15e5f49b5532" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.333291] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('136180c5-94a2-4852-8afe-15e5f49b5532',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.343811] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f743a33-040c-4203-a6ae-3421f862aa22 [ 608.344160] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.344160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.344256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.344610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.344610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.344610] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f743a33-040c-4203-a6ae-3421f862aa22 already deleted. [ 608.344794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f743a33-040c-4203-a6ae-3421f862aa22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.689998] env[70287]: INFO networking_nsxv3.common.synchronization [req-4d430b44-8bf0-4a4d-9924-917905fa4764 req-ff32b2f2-96d5-492d-88eb-ac91eb7fbd56 service nova] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 608.689998] env[70287]: INFO networking_nsxv3.common.synchronization [req-4d430b44-8bf0-4a4d-9924-917905fa4764 req-ff32b2f2-96d5-492d-88eb-ac91eb7fbd56 service nova] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 608.690709] env[70287]: INFO networking_nsxv3.common.synchronization [req-4d430b44-8bf0-4a4d-9924-917905fa4764 req-ff32b2f2-96d5-492d-88eb-ac91eb7fbd56 service nova] Enqueued Resource ID: 62973aa0-57a0-4bb9-a5f1-390b20cbb72b with Priority: HIGHEST for action port [ 608.690883] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 608.690988] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 608.691166] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62973aa0-57a0-4bb9-a5f1-390b20cbb72b with Priority: HIGHEST for action port [ 608.691583] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.691686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.691748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.692482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.692644] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.693594] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.693764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.694014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.694271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.695674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.695843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.695940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.696199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.696495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.696628] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.697563] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.697692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.697760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.699339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.699771] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62973aa0-57a0-4bb9-a5f1-390b20cbb72b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.709369] env[70287]: INFO networking_nsxv3.common.synchronization [req-6f667f43-770e-40ff-bf29-de0b26348c62 req-101d803d-2f15-41b2-844f-7a21592f16f1 tempest-ListImageFiltersTestJSON-688226099 tempest-ListImageFiltersTestJSON-688226099-project-member] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 608.711133] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 608.711133] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.711133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.711133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.711318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.711318] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.711402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.711456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.711615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.711693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.711790] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.834913] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 136180c5-94a2-4852-8afe-15e5f49b5532 [ 608.835128] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.835275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.835343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.835568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.835659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.835753] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:136180c5-94a2-4852-8afe-15e5f49b5532 already deleted. [ 608.835835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-136180c5-94a2-4852-8afe-15e5f49b5532" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.162211] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.162414] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.162538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.162805] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.163072] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.163230] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.163346] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.163557] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.163699] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.163904] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.164037] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.164247] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.164247] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.164377] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 609.164442] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.164573] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.182273] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.182810] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 609.182810] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.182810] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.183066] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-a45b5d7a-845e-4853-ac4d-280c41bbee5b taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.183268] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.183443] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.183772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.183915] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a45b5d7a-845e-4853-ac4d-280c41bbee5b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.204205] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.205441] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.205441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.207102] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62973aa0-57a0-4bb9-a5f1-390b20cbb72b with status ACTIVE [ 609.207355] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.207484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.207550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.207736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.207825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.208039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.208149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.208214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.208547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.208547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.208689] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.208784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.208853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.209035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.209119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.209211] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62973aa0-57a0-4bb9-a5f1-390b20cbb72b is going to be updated. [ 609.215108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.215647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.215647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.215647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.215647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.215867] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.215867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.215867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.216061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.216061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.216155] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 already deleted. [ 609.216201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.229767] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.229767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.229767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.229993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.230205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.230394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62973aa0-57a0-4bb9-a5f1-390b20cbb72b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.692142] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.692142] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port a45b5d7a-845e-4853-ac4d-280c41bbee5b not found, creating... [ 609.692142] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.692142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.692823] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.692823] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.692823] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.692823] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.692823] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.692823] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: a45b5d7a-845e-4853-ac4d-280c41bbee5b is going to be created. [ 609.706414] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.713741] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.713741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.713741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.713741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.713741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.713741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.931276] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: SUCCESS [ 609.933352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.207150] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 in Status: SUCCESS [ 610.207437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.207612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.207848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.208087] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.208226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.208347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.208452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.208536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.208623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.208716] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.210364] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.211140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.212157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.212422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.212498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.212590] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 is going to be created. [ 610.235876] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.238141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.238141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.238141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.238141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.246767] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: UNINITIALIZED for 2s [ 610.715711] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.817117] env[70287]: INFO networking_nsxv3.common.synchronization [req-6f667f43-770e-40ff-bf29-de0b26348c62 req-6250cb69-3426-4eee-823b-f8e0d680a63d service nova] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_rules [ 610.817302] env[70287]: INFO networking_nsxv3.common.synchronization [req-6f667f43-770e-40ff-bf29-de0b26348c62 req-6250cb69-3426-4eee-823b-f8e0d680a63d service nova] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 610.817446] env[70287]: INFO networking_nsxv3.common.synchronization [req-6f667f43-770e-40ff-bf29-de0b26348c62 req-6250cb69-3426-4eee-823b-f8e0d680a63d service nova] Enqueued Resource ID: a45b5d7a-845e-4853-ac4d-280c41bbee5b with Priority: HIGHEST for action port [ 610.817700] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_rules [ 610.817840] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 610.817945] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a45b5d7a-845e-4853-ac4d-280c41bbee5b with Priority: HIGHEST for action port [ 610.819631] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.819884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.819884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.820687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.820687] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.822579] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.822579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.822579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.822579] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.822579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.823084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.823084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.823627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.824086] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.825665] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a45b5d7a-845e-4853-ac4d-280c41bbee5b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.825776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.825848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.826058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.826147] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a45b5d7a-845e-4853-ac4d-280c41bbee5b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.080727] env[70287]: INFO networking_nsxv3.common.synchronization [None req-a57aaa87-abf2-4716-a1bb-23b6ad2fd95c None None] Enqueued Resource ID: 61bb94f0-5d20-4a90-8980-9de34a1769b9 with Priority: HIGHEST for action port [ 611.081347] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61bb94f0-5d20-4a90-8980-9de34a1769b9 with Priority: HIGHEST for action port [ 611.081674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-61bb94f0-5d20-4a90-8980-9de34a1769b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.081850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61bb94f0-5d20-4a90-8980-9de34a1769b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.081906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61bb94f0-5d20-4a90-8980-9de34a1769b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.082206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61bb94f0-5d20-4a90-8980-9de34a1769b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.082302] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61bb94f0-5d20-4a90-8980-9de34a1769b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.217856] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d3161f57-5a3e-445b-998a-3e587c1ae1d7: rpc.has_security_group_logging(os_id): False [ 611.236944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.237575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.237575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.237575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.237575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.237789] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.237855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.237902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.238033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.238099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.238293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 is going to be created. [ 611.324870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.325051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.325126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.325340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.325545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.327378] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.327532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.327690] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.328883] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a45b5d7a-845e-4853-ac4d-280c41bbee5b with status ACTIVE [ 611.328883] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.329080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.329163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.329363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.329551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.329657] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.329760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.329819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.329988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.333203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.333438] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.333562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.333631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.333847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.333941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.334077] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a45b5d7a-845e-4853-ac4d-280c41bbee5b is going to be updated. [ 611.336298] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 in Status: IN_PROGRESS for 2s [ 611.353626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.353732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.353846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.354256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.354256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.354390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a45b5d7a-845e-4853-ac4d-280c41bbee5b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.587026] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61bb94f0-5d20-4a90-8980-9de34a1769b9 [ 611.587026] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.587026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.587026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.587282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.587282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.587346] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61bb94f0-5d20-4a90-8980-9de34a1769b9 already deleted. [ 611.587884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61bb94f0-5d20-4a90-8980-9de34a1769b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.839220] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.256359] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: SUCCESS [ 612.256635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.256850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.257148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.257357] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.257489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.257552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.257693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.257811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.257874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.257988] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.343719] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.343903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.343981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.344260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.344363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.344463] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 is going to be created. [ 612.365978] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.366140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.366196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.366409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.366587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.375274] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: UNINITIALIZED for 2s [ 612.761981] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.267422] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac98ad7d-21c7-4c9e-add9-9d7467bf4897: rpc.has_security_group_logging(os_id): False [ 613.285027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.285027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.285027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.285027] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 is going to be created. [ 613.342475] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.342628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.342692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.342895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.343094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.349651] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 in Status: SUCCESS [ 613.349651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.351172] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: IN_PROGRESS for 2s [ 613.568746] env[70287]: INFO networking_nsxv3.common.synchronization [req-dd798a40-bd3a-4fad-be0f-d609885caa93 req-30b14cbc-d6ff-45b1-bc81-4d693b3a83a4 tempest-ServersTestBootFromVolume-1362117415 tempest-ServersTestBootFromVolume-1362117415-project-member] Enqueued Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_members [ 613.569385] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_members [ 613.569614] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.569984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.569984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.570124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.570287] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.571863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.571863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.571863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.571863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.571863] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.074280] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.075043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.075043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.075043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.075043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.075043] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.075383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.075383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.075383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.075383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.075572] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e already deleted. [ 614.075572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.097090] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-61 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.097090] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-61" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.097090] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-61" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.097390] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-61" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.097608] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.097760] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.097884] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.098217] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.098369] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.098566] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.098683] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.098791] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.099135] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.099135] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 614.099135] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.099344] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.117123] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.117123] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 614.118044] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.118285] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-61" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.118606] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-351666e2-7f1a-4673-bc3f-03c9dddbe45a taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.118969] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.118969] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.119305] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.119479] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('351666e2-7f1a-4673-bc3f-03c9dddbe45a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.386876] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: SUCCESS [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.386876] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.386876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.386876] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.624817] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.625946] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.625946] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.626339] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.626339] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.626488] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 351666e2-7f1a-4673-bc3f-03c9dddbe45a not found, creating... [ 614.626664] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.626827] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.626945] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.627206] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.627364] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.627661] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.627830] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.627960] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.630596] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.630596] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.630596] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 351666e2-7f1a-4673-bc3f-03c9dddbe45a is going to be created. [ 614.652140] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.652140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.652367] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.652584] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.652865] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.653757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.889574] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.890173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.890295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.890474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.890658] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.890753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.890849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.891037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.891131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.891223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.891452] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.891549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.891609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.891750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.891943] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.892060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.892118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.892344] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.892422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.892502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.893023] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.362520] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: SUCCESS [ 615.362740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.397012] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7801a11-9fa5-48e7-852a-cce31e8a5030: rpc.has_security_group_logging(os_id): False [ 615.416692] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.416869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.416949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.417184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.417271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.417540] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.417601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.417643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.417800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.417883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.422281] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.422281] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.422281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.422281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 is going to be created. [ 615.476429] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.476429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.476429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.476429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.476429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.485415] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: IN_PROGRESS for 2s [ 615.813639] env[70287]: INFO networking_nsxv3.common.synchronization [req-dd798a40-bd3a-4fad-be0f-d609885caa93 req-84a272bc-a8a3-4db5-80f3-7980a383042f service nova] Enqueued Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_rules [ 615.813639] env[70287]: INFO networking_nsxv3.common.synchronization [req-dd798a40-bd3a-4fad-be0f-d609885caa93 req-84a272bc-a8a3-4db5-80f3-7980a383042f service nova] Enqueued Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_members [ 615.813639] env[70287]: INFO networking_nsxv3.common.synchronization [req-dd798a40-bd3a-4fad-be0f-d609885caa93 req-84a272bc-a8a3-4db5-80f3-7980a383042f service nova] Enqueued Resource ID: 351666e2-7f1a-4673-bc3f-03c9dddbe45a with Priority: HIGHEST for action port [ 615.813639] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_rules [ 615.813639] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_members [ 615.813639] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 351666e2-7f1a-4673-bc3f-03c9dddbe45a with Priority: HIGHEST for action port [ 615.813639] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.813639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.813639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.814195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.814301] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.817273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.817273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.817273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.817273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.817273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.817602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.817602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.817602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.817695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.817818] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.820665] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-351666e2-7f1a-4673-bc3f-03c9dddbe45a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.822093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.822093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.822093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.822093] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('351666e2-7f1a-4673-bc3f-03c9dddbe45a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.326947] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 351666e2-7f1a-4673-bc3f-03c9dddbe45a with status ACTIVE [ 616.326947] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.326947] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.326947] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.326947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.326947] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 351666e2-7f1a-4673-bc3f-03c9dddbe45a is going to be updated. [ 616.332177] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.332177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.332177] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.353013] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.353236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.353290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.356035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.356035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.356035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-351666e2-7f1a-4673-bc3f-03c9dddbe45a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.835020] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.985109] env[70287]: INFO networking_nsxv3.common.synchronization [req-522d30da-2aca-4ece-b2c6-f135bb7a7e1b req-0c7b66aa-e3ee-46c6-bf55-b00fcf314a88 tempest-ServerDiagnosticsNegativeTest-335203406 tempest-ServerDiagnosticsNegativeTest-335203406-project-member] Enqueued Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_members [ 616.985609] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_members [ 616.985925] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.986076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.986227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.986401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.986529] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.986607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.986661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.986812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.989059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.989219] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.339599] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.339759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.339850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.340148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.340267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.340367] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e is going to be created. [ 617.363839] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.364501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.364501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.364501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.364656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.375350] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e in Status: UNINITIALIZED for 2s [ 617.492511] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.492716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.492792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.493081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.493200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.493419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.493558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.493643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.493819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.493903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.494026] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 already deleted. [ 617.494137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.499313] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: SUCCESS [ 617.499636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.891289] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.891634] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.891634] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.891920] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.892459] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.892665] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.892834] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.893184] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.893372] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.893624] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 617.893783] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.893918] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.894220] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.894316] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 617.894481] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.894677] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.914266] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.914450] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 617.914588] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.914825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.915206] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-8e6b70c9-5969-4828-a278-b4486fbe427d taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.915382] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.915501] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.916557] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.916706] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e6b70c9-5969-4828-a278-b4486fbe427d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.423173] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.423173] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 8e6b70c9-5969-4828-a278-b4486fbe427d not found, creating... [ 618.423173] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.423173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.423591] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.423591] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.424150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.425174] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.425429] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.425839] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 8e6b70c9-5969-4828-a278-b4486fbe427d is going to be created. [ 618.449422] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.449624] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.449753] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.450303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.450303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.450500] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.739877] env[70287]: INFO networking_nsxv3.common.synchronization [req-86bd2fbc-a1a0-4fe8-9708-c52a18919b23 req-a39de546-18f3-4dd6-94f9-59b00160aefe tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 618.740675] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 618.742083] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.742083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.742083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.742083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.742083] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.742083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.742083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.742083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.742669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.742669] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.973784] env[70287]: INFO networking_nsxv3.common.synchronization [req-c39567b3-3423-4aa8-844a-46be5bb062cc req-98975183-f5d3-4526-8a4c-7b1b1d72bb11 tempest-FloatingIPsAssociationNegativeTestJSON-1697391029 tempest-FloatingIPsAssociationNegativeTestJSON-1697391029-project-member] Enqueued Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_members [ 618.974621] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f23e3805-622c-45be-b03e-1e0963f7a65e with Priority: HIGHEST for action security_group_members [ 618.975040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f23e3805-622c-45be-b03e-1e0963f7a65e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.975209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.975515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.975902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.976182] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.976331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.976425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.976652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.977212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.977392] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f23e3805-622c-45be-b03e-1e0963f7a65e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.246381] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.246527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.246602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.246843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.248291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.248291] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.248291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.248291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.248291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.248291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.248291] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 619.273299] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.273499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.273546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.273792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.273950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.282558] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 619.385017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e in Status: SUCCESS [ 619.385252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.385453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.385709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.385957] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.386109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.386195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.389618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.389618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.389618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.389618] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.480510] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.480763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.480910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.481245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.481401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.481701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.481978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.482120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.482410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.482544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.483208] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f23e3805-622c-45be-b03e-1e0963f7a65e is going to be updated. [ 619.508790] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.508909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.508980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.509230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.509382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.518031] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f23e3805-622c-45be-b03e-1e0963f7a65e in Status: IN_PROGRESS for 2s [ 619.893099] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.364058] env[70287]: INFO networking_nsxv3.common.synchronization [req-522d30da-2aca-4ece-b2c6-f135bb7a7e1b req-48a39296-64a4-45e4-abd5-faca426a68a8 service nova] Enqueued Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_rules [ 620.364440] env[70287]: INFO networking_nsxv3.common.synchronization [req-522d30da-2aca-4ece-b2c6-f135bb7a7e1b req-48a39296-64a4-45e4-abd5-faca426a68a8 service nova] Enqueued Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_members [ 620.364573] env[70287]: INFO networking_nsxv3.common.synchronization [req-522d30da-2aca-4ece-b2c6-f135bb7a7e1b req-48a39296-64a4-45e4-abd5-faca426a68a8 service nova] Enqueued Resource ID: 8e6b70c9-5969-4828-a278-b4486fbe427d with Priority: HIGHEST for action port [ 620.365231] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_rules [ 620.365359] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_members [ 620.366200] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e6b70c9-5969-4828-a278-b4486fbe427d with Priority: HIGHEST for action port [ 620.366200] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.366200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.366200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.366200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.366416] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.367337] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.367337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.367337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.367523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.367698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.368879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.368879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.368879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.368879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.368879] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.369653] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-8e6b70c9-5969-4828-a278-b4486fbe427d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.369765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.369870] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.369981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.370412] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8e6b70c9-5969-4828-a278-b4486fbe427d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.395803] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 66c1d37b-c5db-46f6-a3a7-fba9859cd91e: rpc.has_security_group_logging(os_id): False [ 620.414040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.414040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.414307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.414357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.414551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.414677] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.414806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.414902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.415065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.416461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.416461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e is going to be created. [ 620.489400] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.489400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.489400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.489400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.489400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.499922] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e in Status: IN_PROGRESS for 2s [ 620.872072] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.872248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.876600] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8e6b70c9-5969-4828-a278-b4486fbe427d with status ACTIVE [ 620.876758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.876876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.876935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.877163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.877252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.877415] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.877506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.877565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.878279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.878279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.878279] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.878279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.878279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.878279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.878555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.878555] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8e6b70c9-5969-4828-a278-b4486fbe427d is going to be updated. [ 620.880055] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.900377] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.900464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.900568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.900876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.901426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.901426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8e6b70c9-5969-4828-a278-b4486fbe427d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.291861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 621.292126] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 deletion is rescheduled due to dependency. [ 621.292445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.381739] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.529672] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f23e3805-622c-45be-b03e-1e0963f7a65e in Status: SUCCESS [ 621.531831] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f23e3805-622c-45be-b03e-1e0963f7a65e deletion is rescheduled due to dependency. [ 621.531831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f23e3805-622c-45be-b03e-1e0963f7a65e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.884521] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.884726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.884772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.884977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.885116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.885230] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 is going to be created. [ 621.908859] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.908859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.908859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.908859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.909173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.918490] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 in Status: UNINITIALIZED for 2s [ 622.405643] env[70287]: INFO networking_nsxv3.common.synchronization [req-64d26ca5-c1d0-4ee4-89f6-c1ba991b786c req-47312aab-7c69-42bb-835b-4adf1b12dc13 tempest-ListImageFiltersTestJSON-688226099 tempest-ListImageFiltersTestJSON-688226099-project-member] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 622.405643] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 622.406749] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.406749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.406749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.406749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.406749] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.406749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.406749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.407017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.407017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.407017] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.510733] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e in Status: SUCCESS [ 622.512832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.551871] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d665f582-bc4b-4cc7-a4c4-18e50e9863b2 None None] Enqueued Resource ID: 86070f3e-53d3-4d42-a6f9-715a1d19dc11 with Priority: HIGHEST for action port [ 622.551871] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86070f3e-53d3-4d42-a6f9-715a1d19dc11 with Priority: HIGHEST for action port [ 622.552067] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-86070f3e-53d3-4d42-a6f9-715a1d19dc11 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.552067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86070f3e-53d3-4d42-a6f9-715a1d19dc11" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.552067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86070f3e-53d3-4d42-a6f9-715a1d19dc11" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.553991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86070f3e-53d3-4d42-a6f9-715a1d19dc11" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.553991] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86070f3e-53d3-4d42-a6f9-715a1d19dc11',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.913733] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.054603] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86070f3e-53d3-4d42-a6f9-715a1d19dc11 [ 623.055893] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.056055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.056129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.056340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.056430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.056526] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86070f3e-53d3-4d42-a6f9-715a1d19dc11 already deleted. [ 623.056609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86070f3e-53d3-4d42-a6f9-715a1d19dc11" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.418791] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.677118] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.677555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.677737] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.678079] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.678406] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.678623] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.678796] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.679075] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.679279] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.679538] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.679759] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.682021] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.682021] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.682021] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 623.682021] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.682021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.698586] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.698743] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 623.698880] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.699102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.699424] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-d8af3681-c565-4308-9c28-49fd61391243 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.699599] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.699718] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.700097] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.700254] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8af3681-c565-4308-9c28-49fd61391243',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.922855] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.923328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.923449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.924739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.924739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.924739] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 is going to be updated. [ 623.928326] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 in Status: SUCCESS [ 623.928326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.928326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.928326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.928326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.928326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.928326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.928326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.929540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.929540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.929540] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.949286] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.949458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.949499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.949880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.949880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.963174] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: IN_PROGRESS for 2s [ 624.205867] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.205867] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.205867] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.205867] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.205867] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.205867] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port d8af3681-c565-4308-9c28-49fd61391243 not found, creating... [ 624.206290] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.206290] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.206290] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.206574] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.206574] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.206994] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.206994] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.213401] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.214845] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.219951] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.219951] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: d8af3681-c565-4308-9c28-49fd61391243 is going to be created. [ 624.236765] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.239621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.239621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.239621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.239621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.239621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.343471] env[70287]: INFO networking_nsxv3.common.synchronization [None req-90ca2774-ffb4-4a8b-8561-a67576069a6d None None] Enqueued Resource ID: c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce with Priority: HIGHEST for action port [ 624.343930] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce with Priority: HIGHEST for action port [ 624.344419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.344660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.344765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.345234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.345381] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.432670] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.433026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.433026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.433662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.434020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.434126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.434806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.434806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.434944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.435093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.435306] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.435433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.435514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.435706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.435856] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.435952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.436094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.436378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.436378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.436378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.436529] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.847401] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce [ 624.847702] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.848225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.848225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.848225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.848438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.848438] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce already deleted. [ 624.848536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7d45292-aaf8-4a7f-83a9-0f0c6a3584ce" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.940158] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a3a03bdb-ddb5-4fa6-b2d1-eed110e58313: rpc.has_security_group_logging(os_id): False [ 624.957509] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.959359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.959554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.960204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.960379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.960880] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.963195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.963287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.963490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.963637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.963944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.964099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.964166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.964391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.964480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.964972] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.964972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.964972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.965162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.965196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.965294] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 is going to be created. [ 625.024069] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.024556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.024818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.028821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.028821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.036767] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 in Status: IN_PROGRESS for 2s [ 625.618471] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9e40f444-5112-467f-ba2f-e5ecef62d6dc None None] Enqueued Resource ID: ac3beed5-4603-42b6-81cc-3ceaccd2f008 with Priority: HIGHEST for action port [ 625.618848] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac3beed5-4603-42b6-81cc-3ceaccd2f008 with Priority: HIGHEST for action port [ 625.619315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac3beed5-4603-42b6-81cc-3ceaccd2f008 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.619443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac3beed5-4603-42b6-81cc-3ceaccd2f008" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.619508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac3beed5-4603-42b6-81cc-3ceaccd2f008" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.619765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac3beed5-4603-42b6-81cc-3ceaccd2f008" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.619850] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac3beed5-4603-42b6-81cc-3ceaccd2f008',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.966330] env[70287]: INFO networking_nsxv3.common.synchronization [req-64d26ca5-c1d0-4ee4-89f6-c1ba991b786c req-88d24e54-8d26-470d-8c12-fa45a2e7581c service nova] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_rules [ 625.966663] env[70287]: INFO networking_nsxv3.common.synchronization [req-64d26ca5-c1d0-4ee4-89f6-c1ba991b786c req-88d24e54-8d26-470d-8c12-fa45a2e7581c service nova] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 625.966910] env[70287]: INFO networking_nsxv3.common.synchronization [req-64d26ca5-c1d0-4ee4-89f6-c1ba991b786c req-88d24e54-8d26-470d-8c12-fa45a2e7581c service nova] Enqueued Resource ID: d8af3681-c565-4308-9c28-49fd61391243 with Priority: HIGHEST for action port [ 625.967856] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_rules [ 625.968057] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 625.968328] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8af3681-c565-4308-9c28-49fd61391243 with Priority: HIGHEST for action port [ 625.969760] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.970247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.970247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.970451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.970634] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.972487] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.972487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.972691] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8af3681-c565-4308-9c28-49fd61391243 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.972922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.973091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.973364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.974063] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8af3681-c565-4308-9c28-49fd61391243',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.976991] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: SUCCESS [ 625.977257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.978562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.978864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.979134] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.979302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.979404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.979730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.979915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.980188] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.124829] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ac3beed5-4603-42b6-81cc-3ceaccd2f008 [ 626.124829] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.124829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.124829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.124829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.124829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.124829] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ac3beed5-4603-42b6-81cc-3ceaccd2f008 already deleted. [ 626.124829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac3beed5-4603-42b6-81cc-3ceaccd2f008" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.476914] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.477126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.481160] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8af3681-c565-4308-9c28-49fd61391243 with status ACTIVE [ 626.481160] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.481160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.481160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.481160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.481351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.481385] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.483374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.483542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.483747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.483834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.484120] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.484183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.484228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.484408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.484449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.484535] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8af3681-c565-4308-9c28-49fd61391243 is going to be updated. [ 626.489054] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.508447] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.509025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.509110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.509351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.509550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.509777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8af3681-c565-4308-9c28-49fd61391243" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.587845] env[70287]: INFO networking_nsxv3.common.synchronization [None req-81ab3c66-1288-44a5-92bc-eac18df9a4a6 None None] Enqueued Resource ID: d184d994-300b-4531-a695-ff58377b4048 with Priority: HIGHEST for action port [ 626.588060] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d184d994-300b-4531-a695-ff58377b4048 with Priority: HIGHEST for action port [ 626.588200] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d184d994-300b-4531-a695-ff58377b4048 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.588320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d184d994-300b-4531-a695-ff58377b4048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.588386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d184d994-300b-4531-a695-ff58377b4048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.588638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d184d994-300b-4531-a695-ff58377b4048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.588718] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d184d994-300b-4531-a695-ff58377b4048',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.991231] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.056949] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 in Status: SUCCESS [ 627.056949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.095771] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d184d994-300b-4531-a695-ff58377b4048 [ 627.096272] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.096506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.096569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.096960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.096960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.097171] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d184d994-300b-4531-a695-ff58377b4048 already deleted. [ 627.097171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d184d994-300b-4531-a695-ff58377b4048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.253646] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb0e54de-2b7b-4a7a-9a06-7333b6e437fa req-6864e2ff-1879-46f5-8159-39f879ae5840 tempest-ImagesOneServerTestJSON-1980171852 tempest-ImagesOneServerTestJSON-1980171852-project-member] Enqueued Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_members [ 627.253646] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_members [ 627.253646] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.253646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.253646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.253646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.253646] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.254225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.254225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.254225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.254225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.254225] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.493588] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.493918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.493918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.494048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.494137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.494265] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 is going to be updated. [ 627.500431] env[70287]: INFO networking_nsxv3.common.synchronization [None req-e36c845c-0580-4953-a52a-c9d1b6677b43 None None] Enqueued Resource ID: c69e4b1a-e089-48f9-96f6-710a7af628b0 with Priority: HIGHEST for action port [ 627.503271] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c69e4b1a-e089-48f9-96f6-710a7af628b0 with Priority: HIGHEST for action port [ 627.503271] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c69e4b1a-e089-48f9-96f6-710a7af628b0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.503271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c69e4b1a-e089-48f9-96f6-710a7af628b0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.503271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c69e4b1a-e089-48f9-96f6-710a7af628b0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.504421] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c69e4b1a-e089-48f9-96f6-710a7af628b0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.504421] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c69e4b1a-e089-48f9-96f6-710a7af628b0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.526010] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.527440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.527440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.527440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.527440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.537523] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: IN_PROGRESS for 2s [ 627.762398] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.762398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.762398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.762398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.762398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.762398] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.762398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.764333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.764333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.764333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.764333] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c308c6c-418c-4781-8979-52bfbe3999bc already deleted. [ 627.764333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.006180] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c69e4b1a-e089-48f9-96f6-710a7af628b0 [ 628.006493] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.006588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.006588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.006779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.006874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.007078] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c69e4b1a-e089-48f9-96f6-710a7af628b0 already deleted. [ 628.007078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c69e4b1a-e089-48f9-96f6-710a7af628b0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.181685] env[70287]: INFO networking_nsxv3.common.synchronization [None req-2b60fd0c-5526-42ac-be45-dc260aea1ec3 None None] Enqueued Resource ID: 9d0290b9-656d-47ba-97e4-3b29767371ee with Priority: HIGHEST for action port [ 628.182486] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d0290b9-656d-47ba-97e4-3b29767371ee with Priority: HIGHEST for action port [ 628.182681] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d0290b9-656d-47ba-97e4-3b29767371ee taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.182681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d0290b9-656d-47ba-97e4-3b29767371ee" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.182792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d0290b9-656d-47ba-97e4-3b29767371ee" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.185021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d0290b9-656d-47ba-97e4-3b29767371ee" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.185021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d0290b9-656d-47ba-97e4-3b29767371ee',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.681838] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.681988] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-653" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.682354] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-653" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.682586] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-653" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.682763] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.682936] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.685023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.685297] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.685455] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.685668] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.685784] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.686646] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.686804] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.686930] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 628.687126] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.687322] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.689440] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d0290b9-656d-47ba-97e4-3b29767371ee [ 628.690022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.690022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.690022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.690022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.690235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.690235] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d0290b9-656d-47ba-97e4-3b29767371ee already deleted. [ 628.690235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d0290b9-656d-47ba-97e4-3b29767371ee" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.707771] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.707771] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 628.707771] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.707771] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-653" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.708070] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-c843be90-ce12-44ac-9b2a-0474d67cc93e taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.708070] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.708183] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.708500] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.708655] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c843be90-ce12-44ac-9b2a-0474d67cc93e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.211322] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.211612] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.211704] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.211933] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.212116] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.212280] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port c843be90-ce12-44ac-9b2a-0474d67cc93e not found, creating... [ 629.212546] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.212701] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.212814] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.213057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.213196] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.213477] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.214027] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.214525] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.214769] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.214938] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.215058] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: c843be90-ce12-44ac-9b2a-0474d67cc93e is going to be created. [ 629.235420] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.235420] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.235545] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.238466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.238466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.238466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.554075] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: SUCCESS [ 629.554298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.554477] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.554696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.554881] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.555183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.555183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.555712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.555860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.555926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.556072] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.764574] env[70287]: INFO networking_nsxv3.common.synchronization [None req-1d6ff0a4-dd18-48d0-91b2-6ded638f3850 None None] Enqueued Resource ID: 2d31eccd-c350-47d3-8dac-f9fd25b541f5 with Priority: HIGHEST for action port [ 629.764836] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d31eccd-c350-47d3-8dac-f9fd25b541f5 with Priority: HIGHEST for action port [ 629.765439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d31eccd-c350-47d3-8dac-f9fd25b541f5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.765565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d31eccd-c350-47d3-8dac-f9fd25b541f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.766496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d31eccd-c350-47d3-8dac-f9fd25b541f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.766496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d31eccd-c350-47d3-8dac-f9fd25b541f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.766496] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d31eccd-c350-47d3-8dac-f9fd25b541f5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.060377] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.060377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.060377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.060377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.060377] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.060377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.060377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.060377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.060758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.060758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.060758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.060916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.060916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.062185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.062185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.062185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.062185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.062185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.062185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.062185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.062185] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.155390] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb0e54de-2b7b-4a7a-9a06-7333b6e437fa req-82fecdd8-b952-402c-a85a-e2a30575276a service nova] Enqueued Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_rules [ 630.155390] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb0e54de-2b7b-4a7a-9a06-7333b6e437fa req-82fecdd8-b952-402c-a85a-e2a30575276a service nova] Enqueued Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_members [ 630.155390] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb0e54de-2b7b-4a7a-9a06-7333b6e437fa req-82fecdd8-b952-402c-a85a-e2a30575276a service nova] Enqueued Resource ID: c843be90-ce12-44ac-9b2a-0474d67cc93e with Priority: HIGHEST for action port [ 630.155390] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_rules [ 630.155390] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_members [ 630.155390] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c843be90-ce12-44ac-9b2a-0474d67cc93e with Priority: HIGHEST for action port [ 630.158896] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.159096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.159146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.161675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.161675] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.161675] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.161675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.161675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.162730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.162898] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.164362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.164362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.164362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.164362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.164362] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.167813] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c843be90-ce12-44ac-9b2a-0474d67cc93e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.167997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.167997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.167997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.167997] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c843be90-ce12-44ac-9b2a-0474d67cc93e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.272288] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2d31eccd-c350-47d3-8dac-f9fd25b541f5 [ 630.272288] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.272288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.272288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.272288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.272288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.272288] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2d31eccd-c350-47d3-8dac-f9fd25b541f5 already deleted. [ 630.272288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d31eccd-c350-47d3-8dac-f9fd25b541f5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.301045] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9baee8f2-98e9-44c1-ac55-43cd560cc97e None None] Enqueued Resource ID: e702663c-0f12-4710-9216-f7998b23d30d with Priority: HIGHEST for action port [ 630.301045] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e702663c-0f12-4710-9216-f7998b23d30d with Priority: HIGHEST for action port [ 630.301045] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e702663c-0f12-4710-9216-f7998b23d30d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.301045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e702663c-0f12-4710-9216-f7998b23d30d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.301045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e702663c-0f12-4710-9216-f7998b23d30d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.301045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e702663c-0f12-4710-9216-f7998b23d30d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.301045] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e702663c-0f12-4710-9216-f7998b23d30d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.457384] env[70287]: INFO networking_nsxv3.common.synchronization [None req-2cccf2ae-0f09-4bc7-ba03-b5eb25c1f487 None None] Enqueued Resource ID: 3edc57af-772f-4cea-b3ba-fbc90ee56fef with Priority: HIGHEST for action port [ 630.457634] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3edc57af-772f-4cea-b3ba-fbc90ee56fef with Priority: HIGHEST for action port [ 630.458219] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-3edc57af-772f-4cea-b3ba-fbc90ee56fef taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.458856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3edc57af-772f-4cea-b3ba-fbc90ee56fef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.458939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3edc57af-772f-4cea-b3ba-fbc90ee56fef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.460031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3edc57af-772f-4cea-b3ba-fbc90ee56fef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.460649] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3edc57af-772f-4cea-b3ba-fbc90ee56fef',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.563774] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7801a11-9fa5-48e7-852a-cce31e8a5030: rpc.has_security_group_logging(os_id): False [ 630.581535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.581676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.581860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.581965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.582101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.582309] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.582414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.582475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.582633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.582714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.582899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.582994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.583082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.583233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.583309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.583507] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.583600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.583731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.583899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.585879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.585879] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 is going to be updated. [ 630.660995] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.661159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.661228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.661442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.661580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.663221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.664809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.671553] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c843be90-ce12-44ac-9b2a-0474d67cc93e with status ACTIVE [ 630.671667] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.671789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.671915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.672084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.672418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.672737] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.672737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.672932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.672998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.673368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.673368] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.673471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.673506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.673628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.673695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.673835] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c843be90-ce12-44ac-9b2a-0474d67cc93e is going to be updated. [ 630.675315] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.681760] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: IN_PROGRESS for 2s [ 630.696777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.699042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.699042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.699042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.699042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.699042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c843be90-ce12-44ac-9b2a-0474d67cc93e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.806940] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e702663c-0f12-4710-9216-f7998b23d30d [ 630.807186] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.807321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.807388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.807596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.807681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.807775] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e702663c-0f12-4710-9216-f7998b23d30d already deleted. [ 630.808475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e702663c-0f12-4710-9216-f7998b23d30d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.963911] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3edc57af-772f-4cea-b3ba-fbc90ee56fef [ 630.963911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.964035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.964072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.964406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.964406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.964533] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3edc57af-772f-4cea-b3ba-fbc90ee56fef already deleted. [ 630.964533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3edc57af-772f-4cea-b3ba-fbc90ee56fef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.018383] env[70287]: INFO networking_nsxv3.common.synchronization [None req-3690138e-5f80-4d69-97b3-f12f5eb51be4 None None] Enqueued Resource ID: 897a775b-01aa-4646-91e8-41c0ca62b081 with Priority: HIGHEST for action port [ 631.018630] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 897a775b-01aa-4646-91e8-41c0ca62b081 with Priority: HIGHEST for action port [ 631.019198] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-897a775b-01aa-4646-91e8-41c0ca62b081 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.019346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-897a775b-01aa-4646-91e8-41c0ca62b081" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.019395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-897a775b-01aa-4646-91e8-41c0ca62b081" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.019630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-897a775b-01aa-4646-91e8-41c0ca62b081" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.019709] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('897a775b-01aa-4646-91e8-41c0ca62b081',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.179889] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.525358] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 897a775b-01aa-4646-91e8-41c0ca62b081 [ 631.525646] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.525646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.525779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.525899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.525994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.526187] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:897a775b-01aa-4646-91e8-41c0ca62b081 already deleted. [ 631.526743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-897a775b-01aa-4646-91e8-41c0ca62b081" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.685023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.685509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.685618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.685845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.685933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.686059] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c308c6c-418c-4781-8979-52bfbe3999bc is going to be created. [ 631.707811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.707811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.708089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.708136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.708291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.719029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c308c6c-418c-4781-8979-52bfbe3999bc in Status: UNINITIALIZED for 2s [ 632.694374] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: SUCCESS [ 632.694652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.298018] env[70287]: INFO networking_nsxv3.common.synchronization [req-66af0ac8-8ccd-4721-8a43-1f21214a2cc4 req-900eeebb-402f-4e9e-9cad-9218fad8bd8f tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 633.298018] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 633.298541] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.298801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.299069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.299964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.299964] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.299964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.299964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.299964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.300251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.300251] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.661879] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.662211] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.662357] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.662645] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.662951] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.663255] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.663403] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.663997] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.663997] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.663997] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.663997] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.664232] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.664232] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.664371] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 633.664468] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.664666] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.683063] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.683270] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 633.683443] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.683651] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.684059] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-0c91a788-04b4-456c-9b01-ac3c5e099892 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.684244] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.684513] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.685052] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.685303] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c91a788-04b4-456c-9b01-ac3c5e099892',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.727930] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c308c6c-418c-4781-8979-52bfbe3999bc in Status: SUCCESS [ 633.729147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.729147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.729147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.729147] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.729147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.729147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.729508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.729508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.730521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.730660] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.802422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.802608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.802716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.803063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.803195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.803437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.803587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.803677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.803912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.805007] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.805007] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d already deleted. [ 633.805007] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.811616] env[70287]: INFO networking_nsxv3.common.synchronization [req-5139a50a-efd7-4816-b31b-aa6938b9ddbe req-7ee6819f-f364-49d1-904f-8734e967c153 tempest-ServerDiagnosticsNegativeTest-335203406 tempest-ServerDiagnosticsNegativeTest-335203406-project-member] Enqueued Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_members [ 633.812302] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGHEST for action security_group_members [ 633.812654] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.812782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.812849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.814245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.814245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.814245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.814245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.814495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.814552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.814981] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.188249] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.188554] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.188708] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.189082] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.189285] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.189511] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 0c91a788-04b4-456c-9b01-ac3c5e099892 not found, creating... [ 634.189856] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.190113] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.190317] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.190561] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.190767] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.191803] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.191803] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.191803] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.192137] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.192356] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.192547] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 0c91a788-04b4-456c-9b01-ac3c5e099892 is going to be created. [ 634.212418] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.212647] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.212802] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.213138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.213896] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.213896] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.237506] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.237668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.237736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.237969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.238180] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.238298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.238356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.238513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.238601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.238690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.238836] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.238931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.238991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.239184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.239325] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.239419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.239539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.239618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.239693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.239774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.239863] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.316979] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.317304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.317304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.317561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.317561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.317774] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.317855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.318369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.318369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.318369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.318369] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 is going to be updated. [ 634.343731] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.343731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.343731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.344066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.344066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.356134] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 in Status: IN_PROGRESS for 2s [ 634.746409] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5c308c6c-418c-4781-8979-52bfbe3999bc: rpc.has_security_group_logging(os_id): False [ 634.762818] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.762985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.763111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.763340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.763434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.763813] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.763813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.763813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.764065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.764119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.764283] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.764383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.764462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.764662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.764699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.768136] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.768136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.768136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.768136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.768136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.768136] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c308c6c-418c-4781-8979-52bfbe3999bc is going to be created. [ 634.817215] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.817396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.817463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.817685] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.817881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.831506] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c308c6c-418c-4781-8979-52bfbe3999bc in Status: IN_PROGRESS for 2s [ 634.842245] env[70287]: INFO networking_nsxv3.common.synchronization [None req-2f93af64-69db-4c92-8270-406c37783bf7 None None] Enqueued Resource ID: d0878314-60d0-409c-b369-80064d973543 with Priority: HIGHEST for action port [ 634.842510] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0878314-60d0-409c-b369-80064d973543 with Priority: HIGHEST for action port [ 634.843110] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0878314-60d0-409c-b369-80064d973543 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.843239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0878314-60d0-409c-b369-80064d973543" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.843299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0878314-60d0-409c-b369-80064d973543" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.843550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0878314-60d0-409c-b369-80064d973543" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.843636] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0878314-60d0-409c-b369-80064d973543',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.995139] env[70287]: INFO networking_nsxv3.common.synchronization [None req-67738df4-83bf-4490-805a-962af6cfbbd5 None None] Enqueued Resource ID: 08101250-315d-48de-bde0-b7f5ba262a4c with Priority: HIGHEST for action port [ 634.995417] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08101250-315d-48de-bde0-b7f5ba262a4c with Priority: HIGHEST for action port [ 634.995975] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-08101250-315d-48de-bde0-b7f5ba262a4c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.996118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08101250-315d-48de-bde0-b7f5ba262a4c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.996183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08101250-315d-48de-bde0-b7f5ba262a4c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.996628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08101250-315d-48de-bde0-b7f5ba262a4c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.996721] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08101250-315d-48de-bde0-b7f5ba262a4c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.216898] env[70287]: INFO networking_nsxv3.common.synchronization [req-66af0ac8-8ccd-4721-8a43-1f21214a2cc4 req-3ea7a544-9fe0-4b5c-bb5a-4cd13b9f182a service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 635.217143] env[70287]: INFO networking_nsxv3.common.synchronization [req-66af0ac8-8ccd-4721-8a43-1f21214a2cc4 req-3ea7a544-9fe0-4b5c-bb5a-4cd13b9f182a service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 635.217221] env[70287]: INFO networking_nsxv3.common.synchronization [req-66af0ac8-8ccd-4721-8a43-1f21214a2cc4 req-3ea7a544-9fe0-4b5c-bb5a-4cd13b9f182a service nova] Enqueued Resource ID: 0c91a788-04b4-456c-9b01-ac3c5e099892 with Priority: HIGHEST for action port [ 635.217406] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 635.217527] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 635.217682] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c91a788-04b4-456c-9b01-ac3c5e099892 with Priority: HIGHEST for action port [ 635.218354] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.218354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.218354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.218631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.218670] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.220074] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.220197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.221367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.221367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.221367] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.221367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.221367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.221367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.221367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.221367] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.222298] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c91a788-04b4-456c-9b01-ac3c5e099892 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.222298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.222298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.222298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.222298] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c91a788-04b4-456c-9b01-ac3c5e099892',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.345295] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0878314-60d0-409c-b369-80064d973543 [ 635.345535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.345672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.345765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.345975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.346103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.346189] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0878314-60d0-409c-b369-80064d973543 already deleted. [ 635.346267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0878314-60d0-409c-b369-80064d973543" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.499079] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08101250-315d-48de-bde0-b7f5ba262a4c [ 635.499334] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.499473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.499542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.500242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.500350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.500457] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08101250-315d-48de-bde0-b7f5ba262a4c already deleted. [ 635.500547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08101250-315d-48de-bde0-b7f5ba262a4c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.723527] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.724357] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.724482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.724869] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c91a788-04b4-456c-9b01-ac3c5e099892 with status ACTIVE [ 635.725046] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.725161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.725225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.725422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.725506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.725741] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.725816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.725816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.725961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.726041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.726220] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.726313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.726381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.726512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.726775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.726775] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c91a788-04b4-456c-9b01-ac3c5e099892 is going to be updated. [ 635.756583] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.757143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.757143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.757143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.757143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.757511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c91a788-04b4-456c-9b01-ac3c5e099892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.166469] env[70287]: INFO networking_nsxv3.common.synchronization [req-5aa2a3cd-b63e-47bc-a093-6b83be587b34 req-d32b905b-51f7-4f0a-8371-781661c08f26 tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 636.167047] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 636.167354] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.167505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.167592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.167788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.167941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.172292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.172410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.172646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.172732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.172825] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.226112] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.365617] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 in Status: SUCCESS [ 636.365707] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 deletion is rescheduled due to dependency. [ 636.365780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.545265] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.545388] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.545428] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.546086] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.546086] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.546267] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.546497] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.546584] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.550020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.550020] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.550020] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.550020] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.550020] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.550020] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 636.550020] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.550020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.571438] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.571647] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 636.571756] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.572874] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.573071] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-759dea11-a681-4e6a-8166-1b1b1d5744ac taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.573286] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.573402] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.574038] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.574038] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759dea11-a681-4e6a-8166-1b1b1d5744ac',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.675597] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.675818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.675818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.676788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.676911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.677128] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.677248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.677311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.677481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.677550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.677637] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e already deleted. [ 636.677716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.729334] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.729556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.729675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.729943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.730143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.730251] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be created. [ 636.755412] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.755412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.755412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.756476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.756476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.764726] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: UNINITIALIZED for 2s [ 636.842757] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5c308c6c-418c-4781-8979-52bfbe3999bc in Status: SUCCESS [ 636.842992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.076407] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.077555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.077555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.077555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.077555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.077555] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 759dea11-a681-4e6a-8166-1b1b1d5744ac not found, creating... [ 637.077787] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.077787] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.077937] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.078134] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.078333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.078621] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.078780] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.078895] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.079139] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.079281] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.079422] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 759dea11-a681-4e6a-8166-1b1b1d5744ac is going to be created. [ 637.099973] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.100207] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.100332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.100578] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.100827] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.101132] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.034756] env[70287]: INFO networking_nsxv3.common.synchronization [req-5aa2a3cd-b63e-47bc-a093-6b83be587b34 req-e8353e32-6808-48a7-9c9d-93d6fdf6f720 service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 638.037034] env[70287]: INFO networking_nsxv3.common.synchronization [req-5aa2a3cd-b63e-47bc-a093-6b83be587b34 req-e8353e32-6808-48a7-9c9d-93d6fdf6f720 service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 638.037034] env[70287]: INFO networking_nsxv3.common.synchronization [req-5aa2a3cd-b63e-47bc-a093-6b83be587b34 req-e8353e32-6808-48a7-9c9d-93d6fdf6f720 service nova] Enqueued Resource ID: 759dea11-a681-4e6a-8166-1b1b1d5744ac with Priority: HIGHEST for action port [ 638.037386] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 638.037588] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 638.037693] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759dea11-a681-4e6a-8166-1b1b1d5744ac with Priority: HIGHEST for action port [ 638.037975] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.038377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.038500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.038826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.038904] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.040164] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.040334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.040424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.041500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.041657] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.041779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.041846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.042027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.042156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.042238] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.043126] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-759dea11-a681-4e6a-8166-1b1b1d5744ac taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.043257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.043355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.043499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.043583] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759dea11-a681-4e6a-8166-1b1b1d5744ac',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.546248] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 759dea11-a681-4e6a-8166-1b1b1d5744ac with status ACTIVE [ 638.546507] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.546657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.546724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.546943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.547050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.547229] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.547331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.547391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.547536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.547614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.547791] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.547879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.547941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.548096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.548163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.548249] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 759dea11-a681-4e6a-8166-1b1b1d5744ac is going to be updated. [ 638.549742] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.549910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.550104] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.571045] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.571193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.571282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.571492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.571628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.571783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-759dea11-a681-4e6a-8166-1b1b1d5744ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.774879] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 638.774879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.774879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.774879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.775182] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.775182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.775182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.775549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.775549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.775549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.775670] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.052417] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.277722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.278240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.278240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.278240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.278458] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.278458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.279169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.279169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.279169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.279169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.279169] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.279169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.279169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.279441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.279441] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.279441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.279556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.279625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.279704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.279786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.279871] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.555882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.556066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.556137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.556356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.556451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.556556] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be created. [ 639.579137] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.579285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.579396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.579755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.579755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.588168] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: UNINITIALIZED for 2s [ 639.782709] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d: rpc.has_security_group_logging(os_id): False [ 639.801780] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.801780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.801780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.801780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.801780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.802104] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.802104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.802104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.802710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.802710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.802710] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.802710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.802710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.803061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.803061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.804401] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.804401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.804401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.804401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.804401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.804401] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be created. [ 639.865920] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.868052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.868052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.868052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.868052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.881951] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 641.454300] env[70287]: INFO networking_nsxv3.common.synchronization [req-c3c7c707-c8fd-407b-b44b-314cfefbc190 req-2a898a1e-538c-4b57-b279-b8af28b0d8f2 tempest-FloatingIPsAssociationTestJSON-116958673 tempest-FloatingIPsAssociationTestJSON-116958673-project-member] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 641.454300] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 641.454630] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.454761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.454816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.456452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.456690] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.457503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.457503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.457503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.457503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.457503] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.600961] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 641.601204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.601366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.601577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.601768] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.601882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.601946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.602203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.602286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.602374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.602463] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.894117] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 641.894347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.961801] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.961801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.961801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.961801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.961801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.963086] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.963086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.963086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.963086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.963086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.963086] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 already deleted. [ 641.963086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.044198] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.044198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.044198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.044514] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.044815] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.044815] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.045087] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.047130] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.047342] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.048390] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.049107] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.049107] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.049107] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.049107] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 642.049107] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.049107] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.068210] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.068379] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 642.068498] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.068719] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.068980] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-082755b5-f132-4a6a-ba7a-4f89bf432e9f taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.069184] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.069310] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.070738] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.070738] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('082755b5-f132-4a6a-ba7a-4f89bf432e9f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.111049] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.111049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.111049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.111049] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.111521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.111521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.111521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.111629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.111747] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.111857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.111920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.112216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.112346] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.112456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.112518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.112673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.112754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.112867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.113045] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.574764] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.575120] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.575266] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.575564] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.575711] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.575869] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 082755b5-f132-4a6a-ba7a-4f89bf432e9f not found, creating... [ 642.576717] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.576717] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.576887] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.577267] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.577267] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.578056] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.578220] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.578386] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.578643] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.578864] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.578931] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 082755b5-f132-4a6a-ba7a-4f89bf432e9f is going to be created. [ 642.598264] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.598264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.598264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.598264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.598264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.598480] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.615394] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e5e0f30-956b-4713-b190-79d66c86985e: rpc.has_security_group_logging(os_id): False [ 642.632597] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.632769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.632843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.633079] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.633175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.633394] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.633496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.633560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.633719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.633914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.633968] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.634057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.634118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.634305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.634389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.634571] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.634681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.634744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.634992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.635276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.635583] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be created. [ 642.701177] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.701334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.701796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.701796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.702070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.720903] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 643.502303] env[70287]: INFO networking_nsxv3.common.synchronization [req-c3c7c707-c8fd-407b-b44b-314cfefbc190 req-a2ba0702-d367-40bb-b14c-77be2f78d568 service nova] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_rules [ 643.502303] env[70287]: INFO networking_nsxv3.common.synchronization [req-c3c7c707-c8fd-407b-b44b-314cfefbc190 req-a2ba0702-d367-40bb-b14c-77be2f78d568 service nova] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 643.502303] env[70287]: INFO networking_nsxv3.common.synchronization [req-c3c7c707-c8fd-407b-b44b-314cfefbc190 req-a2ba0702-d367-40bb-b14c-77be2f78d568 service nova] Enqueued Resource ID: 082755b5-f132-4a6a-ba7a-4f89bf432e9f with Priority: HIGHEST for action port [ 643.502303] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_rules [ 643.502303] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 643.504843] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 082755b5-f132-4a6a-ba7a-4f89bf432e9f with Priority: HIGHEST for action port [ 643.504843] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.504843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.507029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.507029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.507029] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.507510] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.507608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.507608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.507800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.507966] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.508082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.508142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.508665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.508665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.508665] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.511110] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-082755b5-f132-4a6a-ba7a-4f89bf432e9f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.511110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.511110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.511110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.511110] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('082755b5-f132-4a6a-ba7a-4f89bf432e9f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.873578] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d898c7e4-3a6b-4e29-aca3-8108bd362a98 None None] Enqueued Resource ID: af572829-ce4b-4d2d-b297-571caa212456 with Priority: HIGHEST for action port [ 643.873921] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af572829-ce4b-4d2d-b297-571caa212456 with Priority: HIGHEST for action port [ 643.874486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-af572829-ce4b-4d2d-b297-571caa212456 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.874672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af572829-ce4b-4d2d-b297-571caa212456" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.874672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af572829-ce4b-4d2d-b297-571caa212456" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.874936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af572829-ce4b-4d2d-b297-571caa212456" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.875129] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af572829-ce4b-4d2d-b297-571caa212456',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.014023] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.014023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.014023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.014023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 082755b5-f132-4a6a-ba7a-4f89bf432e9f with status ACTIVE [ 644.014023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.014023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.014023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.014473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.014473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.014473] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.014473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.014473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.014676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.015812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.015812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.015812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.015812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.015812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.015812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.015812] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 082755b5-f132-4a6a-ba7a-4f89bf432e9f is going to be updated. [ 644.034430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.034570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.034639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.034868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.035042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.035218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-082755b5-f132-4a6a-ba7a-4f89bf432e9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.192512] env[70287]: INFO networking_nsxv3.common.synchronization [req-9827feff-b3bd-43d3-8d43-2dbf493871b4 req-2b5cc5f8-47c0-4c23-8be5-e41552aa8b1a tempest-ServersTestJSON-1206130467 tempest-ServersTestJSON-1206130467-project-member] Enqueued Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_members [ 644.193423] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGHEST for action security_group_members [ 644.193847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.194051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.194167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.194415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.194683] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.194879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.195035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.195310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.195450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.195584] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.378574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port af572829-ce4b-4d2d-b297-571caa212456 [ 644.378829] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.378977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.379153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.379277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.379376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.379457] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:af572829-ce4b-4d2d-b297-571caa212456 already deleted. [ 644.379541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af572829-ce4b-4d2d-b297-571caa212456" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.482202] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea4f14bc-dad1-4d47-a4ce-3c2d95ecf084 req-bcacc9bf-4b10-4d36-ba5b-b11eb4655f4b tempest-ServersAdminNegativeTestJSON-1153260158 tempest-ServersAdminNegativeTestJSON-1153260158-project-member] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 644.482813] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 644.484858] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.484858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.484858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.485196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.485254] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.485392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.485480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.487019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.487019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.487019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.512847] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.698337] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.698602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.698683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.698951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.699069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.699325] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.699454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.699575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.699753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.699951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.700085] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc is going to be updated. [ 644.727105] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.727105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.727105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.727406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.727661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.735078] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 644.735078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.735389] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d31850-1f11-444e-b895-cf073f4e7ffc in Status: IN_PROGRESS for 2s [ 644.991070] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.016868] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.016868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.016868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.017105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.017105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.017254] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 is going to be created. [ 645.042402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.043231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.043304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.043678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.044382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.056235] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: UNINITIALIZED for 2s [ 645.140253] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.140253] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.140253] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.141835] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.144347] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.144948] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.147142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.147142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.147142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.147142] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.147142] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 645.147142] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 645.147142] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 645.147142] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 645.147653] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 645.147983] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 645.174303] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 645.174303] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 645.174303] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 645.174303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.174303] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-42ff08f7-25d1-4794-af03-606293181d24 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.174303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.174303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.174303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.174303] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42ff08f7-25d1-4794-af03-606293181d24',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.496283] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.680589] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.680589] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 42ff08f7-25d1-4794-af03-606293181d24 not found, creating... [ 645.680589] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.680589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.681096] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.681096] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.681096] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.681945] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.682206] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.682467] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 42ff08f7-25d1-4794-af03-606293181d24 is going to be created. [ 645.718052] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.718312] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.718440] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.718747] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.718989] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.719274] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.000367] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.001113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.001198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.001458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.001529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.001648] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be updated. [ 646.031933] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.031933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.031933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.032159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.032364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.041081] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: IN_PROGRESS for 2s [ 646.508540] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9082a2f5-ff93-4a22-b203-2d464112c357 tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 646.509147] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 646.509460] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.509625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.509660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.509918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.510021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.541236] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea4f14bc-dad1-4d47-a4ce-3c2d95ecf084 req-86fe05ee-c9fa-475e-a267-ca48bf9cdf3b service nova] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_rules [ 646.541236] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea4f14bc-dad1-4d47-a4ce-3c2d95ecf084 req-86fe05ee-c9fa-475e-a267-ca48bf9cdf3b service nova] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 646.541236] env[70287]: INFO networking_nsxv3.common.synchronization [req-ea4f14bc-dad1-4d47-a4ce-3c2d95ecf084 req-86fe05ee-c9fa-475e-a267-ca48bf9cdf3b service nova] Enqueued Resource ID: 42ff08f7-25d1-4794-af03-606293181d24 with Priority: HIGHEST for action port [ 646.542809] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_rules [ 646.542979] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 646.543123] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42ff08f7-25d1-4794-af03-606293181d24 with Priority: HIGHEST for action port [ 646.543676] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.543879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.543921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.544136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.544213] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.545301] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.545407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.545589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-42ff08f7-25d1-4794-af03-606293181d24 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.545688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.545752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.545927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.546012] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42ff08f7-25d1-4794-af03-606293181d24',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.647771] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d05c4ba2-06b0-4ab0-a1b8-1ed066c332e7 tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 646.647771] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 646.647771] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.647771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.746356] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 30d31850-1f11-444e-b895-cf073f4e7ffc in Status: SUCCESS [ 646.746760] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc deletion is rescheduled due to dependency. [ 646.747027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.774721] env[70287]: INFO networking_nsxv3.common.synchronization [None req-6aecfae5-3719-48bc-aa67-8181f8717182 None None] Enqueued Resource ID: 50efcfd3-9e08-48ad-8357-a2aced4f8a4e with Priority: HIGHEST for action port [ 646.774721] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50efcfd3-9e08-48ad-8357-a2aced4f8a4e with Priority: HIGHEST for action port [ 646.774721] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-50efcfd3-9e08-48ad-8357-a2aced4f8a4e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.774721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50efcfd3-9e08-48ad-8357-a2aced4f8a4e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.774721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50efcfd3-9e08-48ad-8357-a2aced4f8a4e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.774721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50efcfd3-9e08-48ad-8357-a2aced4f8a4e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.775576] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50efcfd3-9e08-48ad-8357-a2aced4f8a4e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.035900] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.035900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.035900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.035900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.035900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.036436] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 already deleted. [ 647.036436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.036436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.036436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.036544] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.049680] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.049680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.049680] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 42ff08f7-25d1-4794-af03-606293181d24 with status ACTIVE [ 647.049919] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.049919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.050009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.051053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.051053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.051053] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.051053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.051053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.051053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.051053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.051053] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.051053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.052020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.052020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.052020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.052020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 42ff08f7-25d1-4794-af03-606293181d24 is going to be updated. [ 647.066069] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: SUCCESS [ 647.066069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.066069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.066249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.066331] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.066521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.066568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.066735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.066812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.066898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.066988] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.078036] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.078036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.078036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.078235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.078266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.080066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42ff08f7-25d1-4794-af03-606293181d24" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.279976] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50efcfd3-9e08-48ad-8357-a2aced4f8a4e [ 647.279976] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.279976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.279976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.279976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.279976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.280306] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50efcfd3-9e08-48ad-8357-a2aced4f8a4e already deleted. [ 647.280306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50efcfd3-9e08-48ad-8357-a2aced4f8a4e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.565150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.565301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.565372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.565647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.565782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.565868] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 already deleted. [ 647.565970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.569501] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.570092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.570092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.570092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.570196] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.570368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.570455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.570647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.570762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.570873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.571040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.571142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.571206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.571356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.571495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.571587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.571650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.571790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.571869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.571947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.572045] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.789636] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ac23e5f3-7a3f-4b31-8029-b17dbd362718 None None] Enqueued Resource ID: e50ff8c5-ab01-4a5f-950e-28e0a2cb714f with Priority: HIGHEST for action port [ 647.792018] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e50ff8c5-ab01-4a5f-950e-28e0a2cb714f with Priority: HIGHEST for action port [ 647.792018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e50ff8c5-ab01-4a5f-950e-28e0a2cb714f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.792018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e50ff8c5-ab01-4a5f-950e-28e0a2cb714f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.792018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e50ff8c5-ab01-4a5f-950e-28e0a2cb714f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.793101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e50ff8c5-ab01-4a5f-950e-28e0a2cb714f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.793194] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e50ff8c5-ab01-4a5f-950e-28e0a2cb714f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.051666] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: SUCCESS [ 648.051924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.052530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.052713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.052907] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.053054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.053109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.053268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.053394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.053476] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.074167] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10ebe6dc-47f0-434b-95e1-44ef22b9a387: rpc.has_security_group_logging(os_id): False [ 648.092170] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.092900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.092900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.092900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.092900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.093089] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.093089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.093089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.093683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.093683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.093683] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.093683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.093683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.093969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.093969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.094521] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.094521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.094521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.094521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.094521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.094843] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 is going to be created. [ 648.149594] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.149832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.149964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.150331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.150628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.161447] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: IN_PROGRESS for 2s [ 648.254798] env[70287]: INFO networking_nsxv3.common.synchronization [req-d56ad2c1-5bc9-435e-8e9b-9a10c9a604d3 req-5491ec47-8109-4a16-8685-68d3cbadc3ed tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 648.255071] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 648.255379] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.255505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.255568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.255827] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.255927] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.257258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.257394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.261268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.261384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.261538] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.297881] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e50ff8c5-ab01-4a5f-950e-28e0a2cb714f [ 648.297881] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.297881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.297881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.297881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.297881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.297881] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e50ff8c5-ab01-4a5f-950e-28e0a2cb714f already deleted. [ 648.297881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e50ff8c5-ab01-4a5f-950e-28e0a2cb714f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.559133] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.763820] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.765262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.765262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.765262] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 648.792048] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.792188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.792787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.792787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.792787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.800839] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 649.062742] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.565878] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.566065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.566140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.566386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.566515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.566624] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be updated. [ 649.593934] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.594122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.594178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.594358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.594504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.603190] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: IN_PROGRESS for 2s [ 650.070151] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ee3827d-a958-4f25-98de-56873d38164a req-8bce20dc-ec2b-4ccd-a0cc-a0f320edf8dd tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 650.070151] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 650.070151] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.070151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.070151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.070151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.070151] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.070151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.070151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.070677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.070864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.071054] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.153012] env[70287]: INFO networking_nsxv3.common.synchronization [None req-94b376b3-f512-467e-af58-42b3490be710 None None] Enqueued Resource ID: 1fac7b19-b723-465e-8ca4-aca8509af8ea with Priority: HIGHEST for action port [ 650.154249] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1fac7b19-b723-465e-8ca4-aca8509af8ea with Priority: HIGHEST for action port [ 650.154915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1fac7b19-b723-465e-8ca4-aca8509af8ea taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.155202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1fac7b19-b723-465e-8ca4-aca8509af8ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.155374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1fac7b19-b723-465e-8ca4-aca8509af8ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.155723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1fac7b19-b723-465e-8ca4-aca8509af8ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.155909] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1fac7b19-b723-465e-8ca4-aca8509af8ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.176603] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: SUCCESS [ 650.177097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.419843] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.420012] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.420151] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.420488] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.420775] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.420935] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.421978] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.422290] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.422457] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.422683] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.422798] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 650.422932] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 650.423059] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 650.423174] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 650.423280] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 650.423501] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 650.444250] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 650.444436] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 650.444587] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 650.445138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.445138] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-7754eb18-94ec-497e-86f6-9038e28638e6 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.445302] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.445390] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.445877] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.445877] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7754eb18-94ec-497e-86f6-9038e28638e6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.573996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.574191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.574269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.575088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.575088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.575403] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.575597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.575711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.575891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.575970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.576086] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a already deleted. [ 650.576185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.658588] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1fac7b19-b723-465e-8ca4-aca8509af8ea [ 650.661018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.661018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.661018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.661018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.661018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.661018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1fac7b19-b723-465e-8ca4-aca8509af8ea already deleted. [ 650.661018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1fac7b19-b723-465e-8ca4-aca8509af8ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.817508] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 650.817508] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d deletion is rescheduled due to dependency. [ 650.817720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.950714] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.950931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.951073] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.951424] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.951512] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.951668] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 7754eb18-94ec-497e-86f6-9038e28638e6 not found, creating... [ 650.951928] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.952087] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.952210] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.952483] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.952619] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.952896] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.953064] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.953181] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.953410] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.953555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.953696] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 7754eb18-94ec-497e-86f6-9038e28638e6 is going to be created. [ 650.978665] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.978665] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.978832] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.979134] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.979401] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.979678] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.524744] env[70287]: INFO networking_nsxv3.common.synchronization [None req-4d68729d-06de-4a4c-b37a-805b3a698ef1 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_rules [ 651.526150] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_rules [ 651.526732] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.526732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.526732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.527102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.527102] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.613541] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: SUCCESS [ 651.613541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.613541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.613789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.614063] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.614198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.614270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.614456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.614538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.614648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.614748] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.841878] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9723fd3a-7674-409f-9df7-9350614c3267 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_rules [ 651.842539] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_rules [ 651.842898] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.843025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.048919] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.048919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.048919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.050050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.050050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.050279] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c already deleted. [ 652.050330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.050537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.051291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.051291] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.120564] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.120758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.120832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.121407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.121407] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.121407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.121407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.122120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.122224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.122382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.123495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.123495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.123495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.123495] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.148904] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ee3827d-a958-4f25-98de-56873d38164a req-0afdb375-58bc-4674-bd1d-3d29360b64e6 service nova] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 652.149149] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ee3827d-a958-4f25-98de-56873d38164a req-0afdb375-58bc-4674-bd1d-3d29360b64e6 service nova] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 652.149340] env[70287]: INFO networking_nsxv3.common.synchronization [req-0ee3827d-a958-4f25-98de-56873d38164a req-0afdb375-58bc-4674-bd1d-3d29360b64e6 service nova] Enqueued Resource ID: 7754eb18-94ec-497e-86f6-9038e28638e6 with Priority: HIGHEST for action port [ 652.149783] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 652.150038] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 652.150206] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7754eb18-94ec-497e-86f6-9038e28638e6 with Priority: HIGHEST for action port [ 652.150530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.150668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.150785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.150994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.150994] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.152312] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.152438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.152514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.154123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.154123] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.154123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.154123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.154123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.154123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.154123] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.154378] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7754eb18-94ec-497e-86f6-9038e28638e6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.154433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.154599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.154764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.154764] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7754eb18-94ec-497e-86f6-9038e28638e6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.577293] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.577582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.577582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.577738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.577828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.577930] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c already deleted. [ 652.578019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.627143] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6d080df-987c-42ee-a1c4-0bd34532e799: rpc.has_security_group_logging(os_id): False [ 652.644239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.644696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.644880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.646409] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.646409] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.646409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.647306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.647496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.647785] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.652117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.652117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.652117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.652117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.652117] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be updated. [ 652.656229] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.660129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.660129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.660129] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7754eb18-94ec-497e-86f6-9038e28638e6 with status ACTIVE [ 652.660662] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.660662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.660662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.661055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.661227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.661732] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.664396] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.664396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.664396] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7754eb18-94ec-497e-86f6-9038e28638e6 is going to be updated. [ 652.688036] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.688193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.688222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.688481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.688691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.689672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7754eb18-94ec-497e-86f6-9038e28638e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.706328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.706328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.706328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.706328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.706328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.721860] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: IN_PROGRESS for 2s [ 652.973210] env[70287]: INFO networking_nsxv3.common.synchronization [req-69c39a68-eec2-48b6-b05c-d4780bd72e51 req-34d2af12-98e0-4953-9af4-e1554a095484 tempest-ServersTestFqdnHostnames-222205351 tempest-ServersTestFqdnHostnames-222205351-project-member] Enqueued Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_members [ 652.973210] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_members [ 652.973210] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e268cb7c-d939-4cae-9df0-54709ed24656 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.973610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.973610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.973882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.973980] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.974130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.975116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.975116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.975116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.975116] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.018691] env[70287]: INFO networking_nsxv3.common.synchronization [req-2dc0b7fc-9ed1-4414-9930-af2f31090e53 req-3a3181df-a806-4b25-8572-276518372dff tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 653.018854] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 653.019461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.019609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.019728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.023208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.023801] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.023940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.023992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.024223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.024320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.024427] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.160575] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.477339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.477562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.477602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.477822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.477954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.478241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.478357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.478425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.478615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.478737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.478834] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e268cb7c-d939-4cae-9df0-54709ed24656 already deleted. [ 653.478931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.526556] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.526728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.526807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.527062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.527198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.527415] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.527522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.527588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.527760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.527867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.527957] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 653.558778] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.558950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.559021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.559262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.559407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.567929] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 653.663450] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.663768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.663768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.663940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.664044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.664142] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be created. [ 653.665873] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.666069] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.666207] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.666567] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.666873] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.667117] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.667277] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.667521] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.667680] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.667929] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.668076] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.668193] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.668300] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.668411] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 653.668515] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.668657] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.688272] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.688448] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 653.688579] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.688774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.689090] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-24475a24-3e1c-4b3f-af26-aa66bf320dc6 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.689274] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.689419] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.689732] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.689871] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24475a24-3e1c-4b3f-af26-aa66bf320dc6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.697382] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.697529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.697575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.697777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.698031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.706722] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: UNINITIALIZED for 2s [ 653.962315] env[70287]: INFO networking_nsxv3.common.synchronization [req-576533f7-c26a-491d-8750-3fb5dc776d5f req-f7664672-1eed-4167-bb21-e133dcb911ad tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_members [ 653.962981] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGHEST for action security_group_members [ 653.963437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.963939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.963939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.963939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.964300] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.964418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.964504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.964683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.964763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.964877] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.194495] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.194736] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.194869] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.195176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.195332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.195493] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 24475a24-3e1c-4b3f-af26-aa66bf320dc6 not found, creating... [ 654.195760] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.195919] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.196045] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.196295] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.196441] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.196723] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.196878] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.196994] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.197217] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.197351] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.197490] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 24475a24-3e1c-4b3f-af26-aa66bf320dc6 is going to be created. [ 654.220424] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.220774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.220866] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.221085] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.221456] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.221528] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.467819] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.468292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.468464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.468775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.469092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.469356] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.469523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.469659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.469914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.470094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.470273] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b is going to be updated. [ 654.494032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.494032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.494207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.494304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.494452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.502679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64eebc83-d0e6-4418-b651-efae0fdea09b in Status: IN_PROGRESS for 2s [ 654.735580] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: SUCCESS [ 654.735855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.074948] env[70287]: INFO networking_nsxv3.common.synchronization [req-69c39a68-eec2-48b6-b05c-d4780bd72e51 req-f9ad2bb2-7a78-4e31-9a85-713631f700fc service nova] Enqueued Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_rules [ 655.074948] env[70287]: INFO networking_nsxv3.common.synchronization [req-69c39a68-eec2-48b6-b05c-d4780bd72e51 req-f9ad2bb2-7a78-4e31-9a85-713631f700fc service nova] Enqueued Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_members [ 655.075053] env[70287]: INFO networking_nsxv3.common.synchronization [req-69c39a68-eec2-48b6-b05c-d4780bd72e51 req-f9ad2bb2-7a78-4e31-9a85-713631f700fc service nova] Enqueued Resource ID: 24475a24-3e1c-4b3f-af26-aa66bf320dc6 with Priority: HIGHEST for action port [ 655.075588] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_rules [ 655.077324] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_members [ 655.077324] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24475a24-3e1c-4b3f-af26-aa66bf320dc6 with Priority: HIGHEST for action port [ 655.077324] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e268cb7c-d939-4cae-9df0-54709ed24656 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.077324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.077324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.077324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.077324] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.079039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e268cb7c-d939-4cae-9df0-54709ed24656 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.079164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.079232] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.079407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.079559] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.079652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.079713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.079878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.080062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.080164] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.082570] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-24475a24-3e1c-4b3f-af26-aa66bf320dc6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.082672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.082726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.082894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.082969] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24475a24-3e1c-4b3f-af26-aa66bf320dc6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.576512] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 655.576700] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 655.576812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.579462] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e268cb7c-d939-4cae-9df0-54709ed24656 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.579462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.587354] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.587354] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24475a24-3e1c-4b3f-af26-aa66bf320dc6 with status ACTIVE [ 655.587354] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.587354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.587354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.587576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.587605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.587794] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.587901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.587963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.588143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.588303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.588408] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.588503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.588565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.588722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.588807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.588903] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24475a24-3e1c-4b3f-af26-aa66bf320dc6 is going to be updated. [ 655.608533] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.608672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.608743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.608933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.609071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.609226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24475a24-3e1c-4b3f-af26-aa66bf320dc6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.721292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 655.721671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.721989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.722375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.722737] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.723088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.723312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.723672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.723858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.724069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.724245] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.090758] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.226369] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.512932] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64eebc83-d0e6-4418-b651-efae0fdea09b in Status: SUCCESS [ 656.512932] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b deletion is rescheduled due to dependency. [ 656.513136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.593364] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.593475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.593554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.593800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.593896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.594092] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e268cb7c-d939-4cae-9df0-54709ed24656 is going to be created. [ 656.616718] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.616891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.616989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.617273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.617525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.626317] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e268cb7c-d939-4cae-9df0-54709ed24656 in Status: UNINITIALIZED for 2s [ 656.732150] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02bff0b8-b4e7-47de-bf5e-9f794b64958a: rpc.has_security_group_logging(os_id): False [ 656.748600] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.748827] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.748960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.749253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.749388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.749809] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.750010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.750010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.750723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.750723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.750723] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be created. [ 656.804978] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.805386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.805481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.805691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.805868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.815927] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 658.638859] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e268cb7c-d939-4cae-9df0-54709ed24656 in Status: SUCCESS [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.638859] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.638859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.638859] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.828082] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 658.828316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.141202] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.643047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e268cb7c-d939-4cae-9df0-54709ed24656: rpc.has_security_group_logging(os_id): False [ 659.662074] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.662074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.662256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.662352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.662462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.662756] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.662884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.662937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.663364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.663364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.663461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e268cb7c-d939-4cae-9df0-54709ed24656 is going to be created. [ 659.723596] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.723766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.723815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.724093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.725065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.744515] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e268cb7c-d939-4cae-9df0-54709ed24656 in Status: IN_PROGRESS for 2s [ 660.076780] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 660.076780] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 660.266081] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3dd4e1-5425-43aa-88e9-7b7a58ae8acf req-873bd8d1-a395-4457-896c-934fd331ad5d tempest-ServersTestManualDisk-1622628182 tempest-ServersTestManualDisk-1622628182-project-member] Enqueued Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_members [ 660.266658] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_members [ 660.266954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.271394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.271485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.271765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.271950] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.272100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.272298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.272368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.272437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.272543] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.740843] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-432 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.741223] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-432" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.741223] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-432" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.742486] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-432" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.742486] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.742486] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.742486] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.746308] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.746379] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.746603] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.746774] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.746944] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.747037] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.747180] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 660.747293] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.747449] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 660.770660] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 660.770858] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 660.771010] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 660.771237] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-432" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.771570] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-91a03b28-f562-4640-961d-886b91361aa9 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.771756] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.771876] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.772214] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.772380] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a03b28-f562-4640-961d-886b91361aa9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.775512] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.775640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.777790] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.777790] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 already deleted. [ 660.777790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.275022] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.275268] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.275396] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.275692] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.275842] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.275996] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 91a03b28-f562-4640-961d-886b91361aa9 not found, creating... [ 661.276300] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.276462] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.276580] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.276803] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.277098] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.277431] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.277594] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.277711] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.277926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.278145] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.278212] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 91a03b28-f562-4640-961d-886b91361aa9 is going to be created. [ 661.298931] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.298931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.298931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.298931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.298931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.298931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.757957] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e268cb7c-d939-4cae-9df0-54709ed24656 in Status: SUCCESS [ 661.758461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.356844] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3dd4e1-5425-43aa-88e9-7b7a58ae8acf req-c219c83e-8b27-48e5-adea-14a6b018981a service nova] Enqueued Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_rules [ 662.357042] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3dd4e1-5425-43aa-88e9-7b7a58ae8acf req-c219c83e-8b27-48e5-adea-14a6b018981a service nova] Enqueued Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_members [ 662.357246] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3dd4e1-5425-43aa-88e9-7b7a58ae8acf req-c219c83e-8b27-48e5-adea-14a6b018981a service nova] Enqueued Resource ID: 91a03b28-f562-4640-961d-886b91361aa9 with Priority: HIGHEST for action port [ 662.357409] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_rules [ 662.357539] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_members [ 662.357655] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91a03b28-f562-4640-961d-886b91361aa9 with Priority: HIGHEST for action port [ 662.360383] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.360631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.360631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.360822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.361093] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.362958] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.362958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.363099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.363328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.363499] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.363604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.363667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.363960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.363960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.364998] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.366197] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-91a03b28-f562-4640-961d-886b91361aa9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.366411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.366525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.366747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.366856] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91a03b28-f562-4640-961d-886b91361aa9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.745120] env[70287]: INFO networking_nsxv3.common.synchronization [req-ba5ca0e5-cf39-4558-a36f-888c07cf97ba req-532d8074-38a4-44f9-a8d8-81ae042520e9 tempest-ServersAdminNegativeTestJSON-1153260158 tempest-ServersAdminNegativeTestJSON-1153260158-project-member] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 662.745763] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 662.745847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.746225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.747027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.747027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.747027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.747167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.747167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.747496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.747496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.747496] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.870861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91a03b28-f562-4640-961d-886b91361aa9 with status ACTIVE [ 662.871149] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.871290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.871492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.871589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.871687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.871896] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.872016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.872085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.872270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.872352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.872605] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.872739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.872814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.872984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.873233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.873233] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91a03b28-f562-4640-961d-886b91361aa9 is going to be updated. [ 662.874846] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.876303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.876410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.898764] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.898764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.898764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.898764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.898764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.898764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91a03b28-f562-4640-961d-886b91361aa9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.988334] env[70287]: INFO networking_nsxv3.common.synchronization [req-15ce3ed0-32cd-4338-8ec6-ba65d8115595 req-2efa7906-6263-4a12-b0d9-cc56b20d6c31 tempest-ServersV294TestFqdnHostnames-340574857 tempest-ServersV294TestFqdnHostnames-340574857-project-member] Enqueued Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_members [ 662.988500] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_members [ 662.988811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.988937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.990975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.993136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.993136] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.993136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.993136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.993136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.993136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.993136] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.249977] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.378237] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.438403] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-778 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.438631] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-778" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.438755] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-778" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.439084] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-778" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.439350] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.439507] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.439778] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.441746] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.441916] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.442142] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.445154] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.445154] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.445154] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.445154] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 663.445154] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.445154] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.462234] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.462527] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 663.462686] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.462871] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-778" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.463208] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-fe528556-b6d4-43cb-b415-576026eedd33 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.463391] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.463519] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.463833] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.463968] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe528556-b6d4-43cb-b415-576026eedd33',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.496250] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.496422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.496498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.496706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.496801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.497009] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.497143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.497208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.497371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.497471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.497615] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a already deleted. [ 663.497674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.753116] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.877276] env[70287]: INFO networking_nsxv3.common.synchronization [None req-b2fc3fe3-92e9-4c08-914f-f7169551b119 None None] Enqueued Resource ID: 9137ba63-fd07-4353-978d-535de0e12904 with Priority: HIGHEST for action port [ 663.877276] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9137ba63-fd07-4353-978d-535de0e12904 with Priority: HIGHEST for action port [ 663.877276] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9137ba63-fd07-4353-978d-535de0e12904 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.877276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9137ba63-fd07-4353-978d-535de0e12904" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.877276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9137ba63-fd07-4353-978d-535de0e12904" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.877276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9137ba63-fd07-4353-978d-535de0e12904" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.881337] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9137ba63-fd07-4353-978d-535de0e12904',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.881337] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.881337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.881337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.881833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.882301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.882301] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 is going to be created. [ 663.904164] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.904319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.904383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.904581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.904748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.915404] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 in Status: UNINITIALIZED for 2s [ 663.969667] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.969895] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.970029] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.970301] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.970446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.970597] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port fe528556-b6d4-43cb-b415-576026eedd33 not found, creating... [ 663.970872] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.971009] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.971129] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.971337] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.971477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.971754] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.971905] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.972026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.972231] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.972361] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.972521] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: fe528556-b6d4-43cb-b415-576026eedd33 is going to be created. [ 663.995315] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.995315] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.995315] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.995315] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.995579] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.996685] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.254665] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.258021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.258021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.258021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.258021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.258021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be updated. [ 664.281816] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.282060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.282143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.282396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.282539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.292107] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: IN_PROGRESS for 2s [ 664.300881] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7cafc7ab-a285-452e-b35d-89dd3636d8d4 None None] Enqueued Resource ID: 40fe0e3e-4be0-422b-a60d-309988b04c0e with Priority: HIGHEST for action port [ 664.301171] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40fe0e3e-4be0-422b-a60d-309988b04c0e with Priority: HIGHEST for action port [ 664.301751] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-40fe0e3e-4be0-422b-a60d-309988b04c0e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.301899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40fe0e3e-4be0-422b-a60d-309988b04c0e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.301939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40fe0e3e-4be0-422b-a60d-309988b04c0e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.302196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40fe0e3e-4be0-422b-a60d-309988b04c0e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.302365] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40fe0e3e-4be0-422b-a60d-309988b04c0e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.380030] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9137ba63-fd07-4353-978d-535de0e12904 [ 664.380030] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.380231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.380231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.380409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.380504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.380929] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9137ba63-fd07-4353-978d-535de0e12904 already deleted. [ 664.380929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9137ba63-fd07-4353-978d-535de0e12904" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.804959] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40fe0e3e-4be0-422b-a60d-309988b04c0e [ 664.805326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.805533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.805648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.805966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.806131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.806280] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40fe0e3e-4be0-422b-a60d-309988b04c0e already deleted. [ 664.806429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40fe0e3e-4be0-422b-a60d-309988b04c0e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.855239] env[70287]: INFO networking_nsxv3.common.synchronization [req-15ce3ed0-32cd-4338-8ec6-ba65d8115595 req-e232d299-ba4e-47fe-a656-e2dc3492bbac service nova] Enqueued Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_rules [ 664.856382] env[70287]: INFO networking_nsxv3.common.synchronization [req-15ce3ed0-32cd-4338-8ec6-ba65d8115595 req-e232d299-ba4e-47fe-a656-e2dc3492bbac service nova] Enqueued Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_members [ 664.856562] env[70287]: INFO networking_nsxv3.common.synchronization [req-15ce3ed0-32cd-4338-8ec6-ba65d8115595 req-e232d299-ba4e-47fe-a656-e2dc3492bbac service nova] Enqueued Resource ID: fe528556-b6d4-43cb-b415-576026eedd33 with Priority: HIGHEST for action port [ 664.857151] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_rules [ 664.857294] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_members [ 664.857377] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe528556-b6d4-43cb-b415-576026eedd33 with Priority: HIGHEST for action port [ 664.857668] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.857856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.857856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.858099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.858181] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.859044] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.859430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.859430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.859842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.859912] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.859970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.860028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.860190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.860280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.861082] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.862027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe528556-b6d4-43cb-b415-576026eedd33 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.862225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.862225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.862451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.862451] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe528556-b6d4-43cb-b415-576026eedd33',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.366225] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe528556-b6d4-43cb-b415-576026eedd33 with status ACTIVE [ 665.366225] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.366225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.366225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.366225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.366225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.366225] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.366715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.366715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.366715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.366715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.366837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.366883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.366929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.367094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.367140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.367222] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe528556-b6d4-43cb-b415-576026eedd33 is going to be updated. [ 665.368450] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.368596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.368782] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.389038] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.389038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.389038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.389038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.389038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.389310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe528556-b6d4-43cb-b415-576026eedd33" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.873127] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.935021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 in Status: SUCCESS [ 665.935021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.935021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.935021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.935021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.935021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.935021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.935452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.935452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.935452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.935533] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.158760] env[70287]: INFO networking_nsxv3.common.synchronization [req-2926de01-4944-4e1c-b094-a935e2090547 req-5b6b9ad9-f174-4dd6-ba88-6bc7aa91b4da tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 666.160512] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 666.160952] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.161282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.161458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.162189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.162556] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.163022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.163470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.163943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.164344] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.164698] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.303113] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: SUCCESS [ 666.303345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.375035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.375331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.375331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.375517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.375577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.375678] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a is going to be created. [ 666.401525] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.401525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.401525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.401525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.401831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.410601] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a in Status: UNINITIALIZED for 2s [ 666.441417] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.504979] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.505201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.509019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.509019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.509019] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.509019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.509019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.509019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.509019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.509019] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.509019] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.509019] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.509019] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.509019] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 666.509019] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.509019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.531956] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.531956] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 666.531956] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.531956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.531956] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-6c854b20-11f9-4013-88ec-03ccb512af5d taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.531956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.531956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.531956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.531956] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c854b20-11f9-4013-88ec-03ccb512af5d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.667169] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.667392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.667430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.667634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.667729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.667915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.668014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.668079] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.668227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.668303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.668388] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 already deleted. [ 666.668468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.945112] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ca57bd1-00de-4346-9352-680cd5a5d975: rpc.has_security_group_logging(os_id): False [ 666.964910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.964910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.964910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.965129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.965197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.965730] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.965869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.965869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.966154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.966255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.966348] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 is going to be created. [ 666.989683] env[70287]: INFO networking_nsxv3.common.synchronization [None req-6454a32b-e27d-47b7-af6e-87a3ecd66bfc None None] Enqueued Resource ID: d0e60670-58b3-415d-9e27-979efbb969a5 with Priority: HIGHEST for action port [ 666.991215] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0e60670-58b3-415d-9e27-979efbb969a5 with Priority: HIGHEST for action port [ 666.992023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0e60670-58b3-415d-9e27-979efbb969a5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.992263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0e60670-58b3-415d-9e27-979efbb969a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.992360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0e60670-58b3-415d-9e27-979efbb969a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.992727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0e60670-58b3-415d-9e27-979efbb969a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.993421] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0e60670-58b3-415d-9e27-979efbb969a5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.024042] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.024200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.024267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.024556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.024665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.035169] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.035169] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.035169] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.035420] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.035566] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.035728] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 6c854b20-11f9-4013-88ec-03ccb512af5d not found, creating... [ 667.036008] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.036177] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.036291] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.036522] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.036659] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.037184] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.037399] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.037517] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.037735] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.037869] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.038050] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 6c854b20-11f9-4013-88ec-03ccb512af5d is going to be created. [ 667.040366] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 in Status: IN_PROGRESS for 2s [ 667.057807] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.058022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.058157] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.058468] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.058719] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.058967] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.311421] env[70287]: INFO networking_nsxv3.common.synchronization [None req-6c0b67bc-1529-435f-ba5e-458f171d0c9b None None] Enqueued Resource ID: d2fb28bd-c708-4350-b5b0-86c4290dd734 with Priority: HIGHEST for action port [ 667.311421] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2fb28bd-c708-4350-b5b0-86c4290dd734 with Priority: HIGHEST for action port [ 667.312037] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2fb28bd-c708-4350-b5b0-86c4290dd734 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.312153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2fb28bd-c708-4350-b5b0-86c4290dd734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.312220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2fb28bd-c708-4350-b5b0-86c4290dd734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.312514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2fb28bd-c708-4350-b5b0-86c4290dd734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.312656] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2fb28bd-c708-4350-b5b0-86c4290dd734',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.495518] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d0e60670-58b3-415d-9e27-979efbb969a5 [ 667.495870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.495870] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.496150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.496405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.496534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.496658] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d0e60670-58b3-415d-9e27-979efbb969a5 already deleted. [ 667.496780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0e60670-58b3-415d-9e27-979efbb969a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.793099] env[70287]: INFO networking_nsxv3.common.synchronization [req-2926de01-4944-4e1c-b094-a935e2090547 req-164a90ae-0d9c-4a59-be34-7fbb85be8923 service nova] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 667.793099] env[70287]: INFO networking_nsxv3.common.synchronization [req-2926de01-4944-4e1c-b094-a935e2090547 req-164a90ae-0d9c-4a59-be34-7fbb85be8923 service nova] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 667.793099] env[70287]: INFO networking_nsxv3.common.synchronization [req-2926de01-4944-4e1c-b094-a935e2090547 req-164a90ae-0d9c-4a59-be34-7fbb85be8923 service nova] Enqueued Resource ID: 6c854b20-11f9-4013-88ec-03ccb512af5d with Priority: HIGHEST for action port [ 667.793099] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 667.793099] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 667.793099] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c854b20-11f9-4013-88ec-03ccb512af5d with Priority: HIGHEST for action port [ 667.794284] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.794604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.794826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.795218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.795419] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.797021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.797021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.797021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.797021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.797545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.798855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.798855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.798855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.798855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.798855] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.801164] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c854b20-11f9-4013-88ec-03ccb512af5d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.804348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.804348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.804348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.804348] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c854b20-11f9-4013-88ec-03ccb512af5d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.816475] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2fb28bd-c708-4350-b5b0-86c4290dd734 [ 667.816475] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.816475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.816475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.816475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.816475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.816475] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2fb28bd-c708-4350-b5b0-86c4290dd734 already deleted. [ 667.816475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2fb28bd-c708-4350-b5b0-86c4290dd734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.302303] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.306073] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c854b20-11f9-4013-88ec-03ccb512af5d with status ACTIVE [ 668.306424] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.306534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.306534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.306765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.306941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.307248] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.307419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.307522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.307770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.307868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.308155] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.308237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.308268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.308474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.308555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.308650] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c854b20-11f9-4013-88ec-03ccb512af5d is going to be updated. [ 668.310141] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.310379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.331351] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.331351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.331351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.331351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.331351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.331351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.422082] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a in Status: SUCCESS [ 668.422082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.422082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.422082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.422385] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.422385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.422385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.422604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.422693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.422781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.422876] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.804952] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.926409] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.052431] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 in Status: SUCCESS [ 669.052865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.307422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.307671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.307671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.307937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.308029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.308101] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be created. [ 669.332613] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.332794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.332899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.333200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.333427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.342596] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: UNINITIALIZED for 2s [ 669.429153] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fa85bd5-519a-4ab3-885c-dd87b56fc10a: rpc.has_security_group_logging(os_id): False [ 669.446564] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.446786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.446786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.446967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.447083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.447324] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.447426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.447492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.447650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.447731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.447814] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a is going to be created. [ 669.507523] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.507744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.507841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.508186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.508460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.518311] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a in Status: IN_PROGRESS for 2s [ 670.643799] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7512b70-5eb9-490b-a463-dde1b8845f5f req-14efe991-51ae-4622-8600-31d67643b7d3 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 670.644368] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 670.644758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.644915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.644987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.645245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.645409] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.645511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.645604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.645828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.646089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.646089] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.114855] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.115323] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.115452] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.115734] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.116015] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.116183] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.116300] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.116521] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.116749] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.117012] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.117155] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 671.117274] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 671.117385] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 671.117499] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 671.117604] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 671.117735] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 671.135882] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 671.136084] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 671.136720] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 671.136720] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.136840] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.136916] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.137921] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.137921] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.137921] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.148186] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.352667] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 671.352904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.353092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.353343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.353725] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.353725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.353838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.353957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.354066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.354158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.354253] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.530596] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a in Status: SUCCESS [ 671.530856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.639763] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.640014] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.640143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.640435] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.640679] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.640833] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 not found, creating... [ 671.641107] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.641266] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.641382] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.641613] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.641747] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.642036] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.642195] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.642314] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.642593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.642791] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.642948] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 is going to be created. [ 671.650651] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.661686] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.661892] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.662024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.662293] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.662589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.662819] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.856796] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.856987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.857093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.857315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.857513] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.857623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.857686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.857836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.857927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.858039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.858187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.858279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.858340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.858483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.858617] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.858705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.858784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.858928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.859014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.859098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.859189] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.152616] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.152844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.152902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.153184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.153285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.153390] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 672.184390] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.184540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.184597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.184864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.185027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.194363] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 672.361714] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e57bed-6bad-4f87-86dc-05486c964c31: rpc.has_security_group_logging(os_id): False [ 672.379597] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.379864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.379931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.382315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.382315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.382315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.382315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.383141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.383141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.383141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.383141] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be created. [ 672.435445] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7d3529d2-d67d-4067-8ef6-84f64714fe74 tempest-ServerActionsV293TestJSON-1180885877 tempest-ServerActionsV293TestJSON-1180885877-project-member] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_rules [ 672.435638] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_rules [ 672.436558] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.436558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.436832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.437015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.437104] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.442424] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.442424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.442568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.442822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.442923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.448696] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7512b70-5eb9-490b-a463-dde1b8845f5f req-29daed5d-9c5a-49da-8fc6-9a99a3a3e46a service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 672.449520] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7512b70-5eb9-490b-a463-dde1b8845f5f req-29daed5d-9c5a-49da-8fc6-9a99a3a3e46a service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 672.449704] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7512b70-5eb9-490b-a463-dde1b8845f5f req-29daed5d-9c5a-49da-8fc6-9a99a3a3e46a service nova] Enqueued Resource ID: e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 with Priority: HIGHEST for action port [ 672.450237] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 672.450431] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 672.450558] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 with Priority: HIGHEST for action port [ 672.451204] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.451204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.451204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.451418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.451485] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.454644] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.455456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.455456] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.455456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.455456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.455698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.455698] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.457502] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 672.536117] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9da58d77-918d-4263-bc1b-dd26174f4dc5 tempest-ServerActionsV293TestJSON-1180885877 tempest-ServerActionsV293TestJSON-1180885877-project-member] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_rules [ 672.536707] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_rules [ 672.537348] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.537552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.955962] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.955962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.961650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.961978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.962159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.963993] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc already deleted. [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.963993] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 with status ACTIVE [ 672.963993] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.963993] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.963993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.964774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.968020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.968020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.968020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.968020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.968020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.968020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.968020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50 is going to be updated. [ 672.968020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.968020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.968020] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.985732] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.985732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.985732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.985732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.985732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.985732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9c63164-b7ca-4b9a-b5a6-23f3e84b7a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.457189] env[70287]: INFO networking_nsxv3.common.synchronization [req-64f5b8d7-6f9c-4056-bd06-d3b8f9babee0 req-3bcea890-cff2-43e5-8247-0cf055747b0b tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 673.460455] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 673.460455] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.460455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.460687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.460717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.462584] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.462584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.462584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.462584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.462584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.462584] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.487226] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.487420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.487530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.487807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.487931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.488123] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc already deleted. [ 673.488260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.967255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.967255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.967581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.967581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.967872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.967935] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.968070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.968170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.968345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.968725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.968850] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 673.994783] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.994933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.995475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.995475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.995566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.004423] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 674.207542] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 674.211462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.211462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.211657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.212091] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.212091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.212091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.212276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.212327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.212888] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.481044] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 674.481797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.631129] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.631368] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.631447] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.631722] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.632963] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.635665] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.636229] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.636229] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.636229] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.636400] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.636728] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.636728] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.636728] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.636838] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 674.636951] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.637089] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.654984] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.655173] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 674.655311] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.655487] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.656292] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.656292] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.656292] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.656498] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.656591] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('225eaa16-9364-4b7b-a373-d4f03b2dfd6c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.714490] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.159435] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.159741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.159741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.159993] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.160535] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.160535] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 225eaa16-9364-4b7b-a373-d4f03b2dfd6c not found, creating... [ 675.160639] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.160717] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.160828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.161054] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.161186] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.161683] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.161683] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.161806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.161909] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.162065] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.162189] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 225eaa16-9364-4b7b-a373-d4f03b2dfd6c is going to be created. [ 675.198837] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.199063] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.199201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.199453] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.199915] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.199915] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.216563] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.720104] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.720104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.720104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.720104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.720104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.720104] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 675.749942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.749942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.749942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.749942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.749942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.758782] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 676.013089] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 676.013269] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 deletion is rescheduled due to dependency. [ 676.013387] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.049213] env[70287]: INFO networking_nsxv3.common.synchronization [req-64f5b8d7-6f9c-4056-bd06-d3b8f9babee0 req-45506948-b55d-43ef-a167-a4fc75ea47cb service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 676.051017] env[70287]: INFO networking_nsxv3.common.synchronization [req-64f5b8d7-6f9c-4056-bd06-d3b8f9babee0 req-45506948-b55d-43ef-a167-a4fc75ea47cb service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 676.051017] env[70287]: INFO networking_nsxv3.common.synchronization [req-64f5b8d7-6f9c-4056-bd06-d3b8f9babee0 req-45506948-b55d-43ef-a167-a4fc75ea47cb service nova] Enqueued Resource ID: 225eaa16-9364-4b7b-a373-d4f03b2dfd6c with Priority: HIGHEST for action port [ 676.051017] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 676.051017] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 676.051017] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 225eaa16-9364-4b7b-a373-d4f03b2dfd6c with Priority: HIGHEST for action port [ 676.051017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.051017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.051458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.051742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.051910] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.053266] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.053959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.054138] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.054424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.054857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.055156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.055292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.056287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.056287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.056287] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.056847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.057110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.057110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.057273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.057306] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('225eaa16-9364-4b7b-a373-d4f03b2dfd6c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.559224] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.560121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.560237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.561176] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 225eaa16-9364-4b7b-a373-d4f03b2dfd6c with status ACTIVE [ 676.561346] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.561455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.561514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.561704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.561795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.561958] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.562064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.562131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.562273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.562361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.562565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.562687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.562687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.562802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.562879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.562961] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 225eaa16-9364-4b7b-a373-d4f03b2dfd6c is going to be updated. [ 676.582362] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.582760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.582884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.583148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.583345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.583792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-225eaa16-9364-4b7b-a373-d4f03b2dfd6c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.062093] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.565631] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.566027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.566027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.566243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.566341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.566529] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 677.596209] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.596386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.596386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.596618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.596765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.605209] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 677.769899] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 677.770133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.770195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.770562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.770768] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.770896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.771012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.771140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.771224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.771323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.771426] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.274054] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.274224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.274298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.274594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.274798] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.274909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.275320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.275320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.275320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.275320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.275475] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.275562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.275624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.275768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.275904] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.275992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.276061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.276201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.276270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.276350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.276449] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.778412] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 678.799021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.799021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.799021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.799021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.799595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.799595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.799742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.799999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.800187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.800358] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 678.861086] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.861256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.861295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.861544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.861753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.874192] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 679.250143] env[70287]: INFO networking_nsxv3.common.synchronization [req-0e9f7c68-22a5-420e-bf7c-beba67ce9c59 req-a5b8e480-4b87-47bb-9d10-6afcba3880cb tempest-ImagesOneServerTestJSON-1980171852 tempest-ImagesOneServerTestJSON-1980171852-project-member] Enqueued Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_members [ 679.252649] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGHEST for action security_group_members [ 679.254524] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.254946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.255796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.255796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.255796] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.255796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.255796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.256164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.256164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.256276] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.514774] env[70287]: INFO networking_nsxv3.common.synchronization [req-f608fe26-0341-4c89-be30-e99bd34b3ffc req-087a1718-1ec2-44c7-85b6-6a8849306646 tempest-ServerGroupTestJSON-49991975 tempest-ServerGroupTestJSON-49991975-project-member] Enqueued Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_members [ 679.515912] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_members [ 679.516778] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e02cb19-0821-42f3-a922-f67afc4bab0d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.517710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.517710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.517710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.518310] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.518670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.518754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.518959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.519204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.519578] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.617486] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.617486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.617486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.617486] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.758442] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.758647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.758724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.758988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.759100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.759307] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.759420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.759467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.760062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.760062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.760062] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c308c6c-418c-4781-8979-52bfbe3999bc is going to be updated. [ 679.785400] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.785665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.785665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.785864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.786026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.796835] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c308c6c-418c-4781-8979-52bfbe3999bc in Status: IN_PROGRESS for 2s [ 680.023100] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.024751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.025214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.026158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.030243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.030672] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.031219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.031219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.031219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.031219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.031354] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d already deleted. [ 680.031354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.119630] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.119855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.119927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.120164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.120401] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.120535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.120628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.120837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.120962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.121085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.121262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.121367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.121468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.121624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.121778] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.122314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.122314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.122314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.122314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.122314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.122722] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.264751] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-581 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.264751] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-581" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.264956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-581" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.266453] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-581" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.266453] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.266453] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.266453] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.266453] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.266453] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.266759] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.266759] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.266839] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.267504] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.267504] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 680.267504] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.267504] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.288345] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.288345] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 680.288345] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.288345] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-581" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.288345] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-7325d5cd-bcf2-45a4-9199-ce61d63c5746 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.288345] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.288345] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.288345] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.288345] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7325d5cd-bcf2-45a4-9199-ce61d63c5746',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.545903] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f0fc299-836c-40c6-bb5a-00005b15c53f req-a4392827-67b0-4e7f-b546-0d142529d845 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 680.546094] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f0fc299-836c-40c6-bb5a-00005b15c53f req-a4392827-67b0-4e7f-b546-0d142529d845 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 680.547275] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 680.547275] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 680.548561] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.548697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.548767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.548960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.549126] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.549959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.550064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.550205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.550291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.550385] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.552243] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.552243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.552243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.552243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.552243] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.552243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.552243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.552691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.552691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.552691] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.603604] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f0fc299-836c-40c6-bb5a-00005b15c53f req-a4392827-67b0-4e7f-b546-0d142529d845 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_rules [ 680.603848] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f0fc299-836c-40c6-bb5a-00005b15c53f req-a4392827-67b0-4e7f-b546-0d142529d845 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 680.604015] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f0fc299-836c-40c6-bb5a-00005b15c53f req-a4392827-67b0-4e7f-b546-0d142529d845 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 680.604153] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f0fc299-836c-40c6-bb5a-00005b15c53f req-a4392827-67b0-4e7f-b546-0d142529d845 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 680.604283] env[70287]: INFO networking_nsxv3.common.synchronization [req-1f0fc299-836c-40c6-bb5a-00005b15c53f req-a4392827-67b0-4e7f-b546-0d142529d845 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 6c854b20-11f9-4013-88ec-03ccb512af5d with Priority: HIGHEST for action port [ 680.607692] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_rules [ 680.607692] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 680.607692] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c854b20-11f9-4013-88ec-03ccb512af5d with Priority: HIGHEST for action port [ 680.607692] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 680.607861] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 680.608939] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.608939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.608939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.609139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.609139] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.610671] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.610671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.610671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.612980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.612980] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.612980] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c854b20-11f9-4013-88ec-03ccb512af5d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.612980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.612980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.612980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.612980] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c854b20-11f9-4013-88ec-03ccb512af5d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.613292] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.613292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.614039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.614039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.627510] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5344b0-d8f6-49cd-abc4-1a415b3aa399: rpc.has_security_group_logging(os_id): False [ 680.644272] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.644448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.644500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.644688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.644828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.646694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.646694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.646694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.646694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.647277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.647277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.647277] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 680.704339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.704588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.704588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.704794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.704942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.715585] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 680.790178] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.790517] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.790599] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.791065] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.791236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.791384] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 7325d5cd-bcf2-45a4-9199-ce61d63c5746 not found, creating... [ 680.791643] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.791874] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.791923] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.792159] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.792296] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.792638] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.792815] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.792917] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.793136] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.793263] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.793400] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 7325d5cd-bcf2-45a4-9199-ce61d63c5746 is going to be created. [ 680.830417] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.830811] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.831055] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.831427] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.831783] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.832164] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.888117] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 680.890544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.056400] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.057378] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.115334] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.115534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.115845] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.115981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.116190] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c854b20-11f9-4013-88ec-03ccb512af5d with status ACTIVE [ 681.116364] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.116583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.119021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.119021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.119021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.119021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c854b20-11f9-4013-88ec-03ccb512af5d is going to be updated. [ 681.140472] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.140779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.140950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.141277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.141431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.141592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.340215] env[70287]: INFO networking_nsxv3.common.synchronization [req-068fef08-1584-4127-b08c-96bf15849ebb req-53d97228-e119-469f-8c46-eb5166e0192c tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 681.340215] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 681.340215] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.340215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.340215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.341041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.341332] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.341639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.341792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.342126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.342296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.342458] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.559611] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.560447] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.675122] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_members [ 681.675122] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 681.675122] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 681.675122] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_members [ 681.675122] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 681.675122] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 681.675122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.675122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.675122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.676622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.676902] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.677130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.677271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.677520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.677877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.678069] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.678992] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.679983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.679983] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.679983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.790170] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.790375] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.790592] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.790825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.791093] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.791250] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.791363] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.791573] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.791719] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.791929] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.792065] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.792234] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.792357] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.792474] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 681.792611] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.792741] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.803127] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_rules [ 681.803377] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 681.803523] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 681.803664] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 681.803799] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_rules [ 681.803925] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_members [ 681.804938] env[70287]: INFO networking_nsxv3.common.synchronization [req-14b805a0-8517-4bd9-8599-1cf56c68a450 req-f6582ff0-520c-4071-8e39-c81f65b2da4b tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 6c854b20-11f9-4013-88ec-03ccb512af5d with Priority: HIGHEST for action port [ 681.805709] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_rules [ 681.805855] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 681.805980] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_members [ 681.806099] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c854b20-11f9-4013-88ec-03ccb512af5d with Priority: HIGHEST for action port [ 681.806246] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_rules [ 681.806246] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 681.806315] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 681.806581] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.806704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.806882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.806961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.807446] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.807576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.807788] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c854b20-11f9-4013-88ec-03ccb512af5d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.810617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.810728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.810968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.811073] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c854b20-11f9-4013-88ec-03ccb512af5d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.812804] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.812929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.813009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.813266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.813354] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.818707] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.818707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.818707] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.818707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.818707] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.818707] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 681.818707] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.818707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.818707] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-fc7faf6f-9340-433b-99f3-0a1c93e8b609 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.818707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.818707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.819828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.819828] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7faf6f-9340-433b-99f3-0a1c93e8b609',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.822357] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5c308c6c-418c-4781-8979-52bfbe3999bc in Status: SUCCESS [ 681.822357] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5c308c6c-418c-4781-8979-52bfbe3999bc deletion is rescheduled due to dependency. [ 681.822756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.844492] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.844650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.844730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.845300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.845300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.845534] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.845655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.845655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.849043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.849043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.849043] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 already deleted. [ 681.849043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.910977] env[70287]: INFO networking_nsxv3.common.synchronization [req-f608fe26-0341-4c89-be30-e99bd34b3ffc req-839b221a-7932-4e3b-844b-ddb3b7d39ddd service nova] Enqueued Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_rules [ 681.911196] env[70287]: INFO networking_nsxv3.common.synchronization [req-f608fe26-0341-4c89-be30-e99bd34b3ffc req-839b221a-7932-4e3b-844b-ddb3b7d39ddd service nova] Enqueued Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_members [ 681.911336] env[70287]: INFO networking_nsxv3.common.synchronization [req-f608fe26-0341-4c89-be30-e99bd34b3ffc req-839b221a-7932-4e3b-844b-ddb3b7d39ddd service nova] Enqueued Resource ID: 7325d5cd-bcf2-45a4-9199-ce61d63c5746 with Priority: HIGHEST for action port [ 681.911574] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_rules [ 681.911702] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_members [ 681.911795] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7325d5cd-bcf2-45a4-9199-ce61d63c5746 with Priority: HIGHEST for action port [ 681.912376] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3e02cb19-0821-42f3-a922-f67afc4bab0d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.912555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.912625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.912900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.912973] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.913812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e02cb19-0821-42f3-a922-f67afc4bab0d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.913927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.917096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.917096] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.917096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7325d5cd-bcf2-45a4-9199-ce61d63c5746 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.917096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.917096] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7325d5cd-bcf2-45a4-9199-ce61d63c5746',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.062422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.062422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.062422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.062604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.062647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.062782] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 682.065720] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.065866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.065927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.066150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.066191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.066332] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be created. [ 682.084914] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.084914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.084914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.084914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.084914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.090911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.090911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.091087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.091516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.091516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.095293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: UNINITIALIZED for 2s [ 682.096635] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 682.180930] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.316012] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.316155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.324047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c854b20-11f9-4013-88ec-03ccb512af5d with status ACTIVE [ 682.324249] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.324376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.324447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.324660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.324751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.324944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.325036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.325162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.325244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.325323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325498] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.325591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.325653] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.325803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.325903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.325993] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c854b20-11f9-4013-88ec-03ccb512af5d is going to be updated. [ 682.327566] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.327743] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.327867] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.328099] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.328238] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.328380] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port fc7faf6f-9340-433b-99f3-0a1c93e8b609 not found, creating... [ 682.328619] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.328817] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.328939] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.329168] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.329307] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.329576] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.329730] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.329847] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.330062] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.330197] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.330336] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: fc7faf6f-9340-433b-99f3-0a1c93e8b609 is going to be created. [ 682.350890] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.351111] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.351237] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.351550] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.351718] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.351936] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.353437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.353601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.353758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.354016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.354211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.354411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c854b20-11f9-4013-88ec-03ccb512af5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.418377] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e02cb19-0821-42f3-a922-f67afc4bab0d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.418648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.418708] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.419620] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7325d5cd-bcf2-45a4-9199-ce61d63c5746 with status ACTIVE [ 682.419979] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.419979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.419979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.420240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.420240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.420389] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.420793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.420793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.420793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.420934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.421066] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.421157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.421217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.421356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.421427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.421507] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7325d5cd-bcf2-45a4-9199-ce61d63c5746 is going to be updated. [ 682.522354] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.522354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.522354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.522354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.522354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.522354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7325d5cd-bcf2-45a4-9199-ce61d63c5746" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.683419] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.727780] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 682.728137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.923711] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.167527] env[70287]: INFO networking_nsxv3.common.synchronization [req-068fef08-1584-4127-b08c-96bf15849ebb req-5ed00b6a-b045-4021-8530-f5b9cba53d5b service nova] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_rules [ 683.167705] env[70287]: INFO networking_nsxv3.common.synchronization [req-068fef08-1584-4127-b08c-96bf15849ebb req-5ed00b6a-b045-4021-8530-f5b9cba53d5b service nova] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 683.167841] env[70287]: INFO networking_nsxv3.common.synchronization [req-068fef08-1584-4127-b08c-96bf15849ebb req-5ed00b6a-b045-4021-8530-f5b9cba53d5b service nova] Enqueued Resource ID: fc7faf6f-9340-433b-99f3-0a1c93e8b609 with Priority: HIGHEST for action port [ 683.168084] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_rules [ 683.168210] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 683.168300] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc7faf6f-9340-433b-99f3-0a1c93e8b609 with Priority: HIGHEST for action port [ 683.168836] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.168987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.169244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.169590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.169671] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.170646] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.170917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.170917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.171131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.171361] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.171504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.171596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.171832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.171970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.172082] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.173240] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc7faf6f-9340-433b-99f3-0a1c93e8b609 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.173240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.173464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.173464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.173591] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7faf6f-9340-433b-99f3-0a1c93e8b609',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.186149] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.186149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.186149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.186326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.186326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.186453] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4de514c-a329-428e-aef2-824011ac27e1 is going to be created. [ 683.222822] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.222967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.223045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.223264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.223416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.234736] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: UNINITIALIZED for 2s [ 683.428783] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.428947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.429033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.429348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.429483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.429593] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d is going to be created. [ 683.455023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.455182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.455292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.455462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.455669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.470058] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d in Status: UNINITIALIZED for 2s [ 683.676857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.676857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.676857] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.678616] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc7faf6f-9340-433b-99f3-0a1c93e8b609 with status ACTIVE [ 683.678616] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.679436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.679544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.679787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.679947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.680199] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.680382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.680479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.680683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.680772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.680981] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.681095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.681157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.681293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.681370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.681454] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc7faf6f-9340-433b-99f3-0a1c93e8b609 is going to be updated. [ 683.703811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.703811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.703811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.704056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.704485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.705054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc7faf6f-9340-433b-99f3-0a1c93e8b609" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.104400] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 684.104716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.104915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.105144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.105329] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.105680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.105680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.105803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.105923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.106105] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.108028] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 684.108028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.108150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.108362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.108648] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.109507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.109507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.109507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.109507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.109507] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.188305] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.612479] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.613535] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.690956] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.691160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.691228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.691431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.691540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.691622] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be created. [ 684.713457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.713457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.713457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.713598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.713627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.721940] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: UNINITIALIZED for 2s [ 685.118720] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.119958] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.262025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: SUCCESS [ 685.262025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.262025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.262025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.262025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.262025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.262025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.262025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.262025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.262025] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.478567] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d in Status: SUCCESS [ 685.479802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.479802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.479802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.479802] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.480348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.480348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.480348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.480482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.481075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.481075] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.623234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.623451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.623610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.623903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.624141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.624305] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 685.626076] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.626076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.626076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.626701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.626701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.626701] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be updated. [ 685.652224] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.652453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.652492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.652823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.652960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.655018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.655131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.655131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.655281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.655429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.664220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: IN_PROGRESS for 2s [ 685.664846] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 685.766257] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.986154] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e02cb19-0821-42f3-a922-f67afc4bab0d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992693] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.992693] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e02cb19-0821-42f3-a922-f67afc4bab0d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992693] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.992693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.993650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.993650] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.269960] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.501480] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3e02cb19-0821-42f3-a922-f67afc4bab0d: rpc.has_security_group_logging(os_id): False [ 686.519040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.519271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.519271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.519441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.519538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.519732] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.519903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.519903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.520073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.520126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.520321] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.520416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.520473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.520967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.520967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.520967] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.520967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.521219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.521315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.521400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.521507] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d is going to be created. [ 686.663234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.663234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.663234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.663234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.663234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.672460] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d in Status: IN_PROGRESS for 2s [ 686.730688] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 686.730947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.731142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.731391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.731596] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.731712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.731803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.731938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.732023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.732138] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.732249] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.772589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.772932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.772932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.773191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.773284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.773411] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4de514c-a329-428e-aef2-824011ac27e1 is going to be updated. [ 686.800235] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.800438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.800494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.800737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.800956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.810046] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: IN_PROGRESS for 2s [ 686.906576] env[70287]: INFO networking_nsxv3.common.synchronization [req-a2db3927-1f64-46e0-be0e-6e8452cb5733 req-311573a0-0df0-49e7-b563-ce2f02a0bd2d tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 686.907800] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 686.908221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.908587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.908587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.908803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.909056] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.909206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.909328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.909585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.909728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.909852] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.936402] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f26cecfb-79ed-4aa9-bcd7-4fafc71a9d2a tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_rules [ 686.936402] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_rules [ 686.936402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.936402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.936402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.936734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.937392] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.051823] env[70287]: INFO networking_nsxv3.common.synchronization [None req-0ab9deff-08a7-4d26-8d37-64783233ca79 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_rules [ 687.052426] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_rules [ 687.052790] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.052931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.238497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.239339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.239557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.239861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.240129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.240698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.240831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.241047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.241289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.241289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.241462] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.241560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.241619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.241769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.241912] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.242016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.242237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.242321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.242393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.242489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.242581] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.415204] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.459568] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.459568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.459568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.459568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.459568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.459568] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea already deleted. [ 687.459568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.459568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.459568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.459568] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.676639] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 687.676639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.676823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.677282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.677572] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.677798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.677876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.678020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.678108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.678167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.678275] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.680190] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 687.680815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.680815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.680815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.681031] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.681031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.681167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.681213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.681299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.681387] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.682126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.682323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.682441] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.682532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.682587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.682758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.682930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.682930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.683035] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.685423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.685613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.685771] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.685949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.685949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.686172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.686172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.686225] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.745037] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c8498fc-c714-4100-81f9-c85ac268aab7: rpc.has_security_group_logging(os_id): False [ 687.761728] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.761877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.761963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.762210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.762300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.762759] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.763149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.763221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.763388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.763471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.763704] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.763844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.763933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.764124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.764206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.764413] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.764517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.764576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.764703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.764780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.764864] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be created. [ 687.823846] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.823846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.823846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.823846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.823846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.836303] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 687.917950] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.979960] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.980174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.980265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.980491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.980684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.980793] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea already deleted. [ 687.980885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.185525] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.186500] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.187258] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.187369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.187550] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.421037] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.421037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.421037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.421441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.421441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.421441] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 688.447682] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.447799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.447919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.448193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.448340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.462234] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 688.594486] env[70287]: INFO networking_nsxv3.common.synchronization [req-539de1f0-3f36-4215-9203-d5ed7abe395a req-afc06c88-fd30-4fc0-b1e3-61bd0900e6d9 tempest-ServerAddressesTestJSON-1917547805 tempest-ServerAddressesTestJSON-1917547805-project-member] Enqueued Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_members [ 688.594486] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_members [ 688.594486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-03f7a97c-14e5-4707-a109-e07660e131ff taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.594486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.594486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.594486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.594486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.594486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.594889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.594889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.594889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.595086] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.684461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d in Status: SUCCESS [ 688.684727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.689618] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.690500] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33f97a48-67cf-4681-a4ae-50c22c693573: rpc.has_security_group_logging(os_id): False [ 688.691540] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.707555] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.707715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.707772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.707971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.708077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.708302] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.708408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.708469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.708630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.708707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.708797] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be created. [ 688.764886] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.765353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.765353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.765565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.765692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.776792] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: IN_PROGRESS for 2s [ 688.819041] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: SUCCESS [ 688.819180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.819244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.821068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.821068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.821068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.821068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.821068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.821068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.821068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.821068] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.021715] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.021957] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.022165] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.022511] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.022919] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.023167] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.023263] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.023681] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.023798] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.024093] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.024259] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 689.024396] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 689.024578] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 689.024730] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 689.024874] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 689.025072] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 689.042927] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 689.043138] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 689.043293] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 689.043488] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-734" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.043844] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-fa53f5f6-1645-4a7a-a879-a0a5795e1237 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.044044] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.044170] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.044519] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.044661] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa53f5f6-1645-4a7a-a879-a0a5795e1237',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.100824] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.101065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.101065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.102799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.102957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.103214] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.103339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.103411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.104522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.104645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.104743] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03f7a97c-14e5-4707-a109-e07660e131ff already deleted. [ 689.104843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.193448] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.193642] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.193739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.193974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.194107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.194214] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be updated. [ 689.195606] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.195733] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.195822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.196031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.196126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.196219] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 689.240129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.240297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.240350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.240602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.241781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.244032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.244032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.244032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.244032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.244032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.257020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: IN_PROGRESS for 2s [ 689.257020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 689.324512] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.548934] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.549465] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.549465] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.549808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.550031] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.550257] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port fa53f5f6-1645-4a7a-a879-a0a5795e1237 not found, creating... [ 689.550592] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.550825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.551035] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.551347] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.551566] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.551917] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.552164] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.552349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.552621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.552828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.553050] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: fa53f5f6-1645-4a7a-a879-a0a5795e1237 is going to be created. [ 689.572815] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.573050] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.573177] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.573449] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.573696] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.573982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.829014] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4de514c-a329-428e-aef2-824011ac27e1: rpc.has_security_group_logging(os_id): False [ 689.849376] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 689.849376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.849376] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.849376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.849376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.849684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.849684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.853020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.853020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.853020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.853020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.854092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.854468] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4de514c-a329-428e-aef2-824011ac27e1 is going to be created. [ 689.904054] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.904283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.904423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.904715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.904910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.915062] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: IN_PROGRESS for 2s [ 690.368936] env[70287]: INFO networking_nsxv3.common.synchronization [req-539de1f0-3f36-4215-9203-d5ed7abe395a req-271a57e0-160c-43ab-a4f4-c80d5a95f0c9 service nova] Enqueued Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_rules [ 690.369145] env[70287]: INFO networking_nsxv3.common.synchronization [req-539de1f0-3f36-4215-9203-d5ed7abe395a req-271a57e0-160c-43ab-a4f4-c80d5a95f0c9 service nova] Enqueued Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_members [ 690.369556] env[70287]: INFO networking_nsxv3.common.synchronization [req-539de1f0-3f36-4215-9203-d5ed7abe395a req-271a57e0-160c-43ab-a4f4-c80d5a95f0c9 service nova] Enqueued Resource ID: fa53f5f6-1645-4a7a-a879-a0a5795e1237 with Priority: HIGHEST for action port [ 690.369839] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_rules [ 690.369974] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_members [ 690.370099] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa53f5f6-1645-4a7a-a879-a0a5795e1237 with Priority: HIGHEST for action port [ 690.370642] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-03f7a97c-14e5-4707-a109-e07660e131ff taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.370760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.370844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.371155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.371244] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.372137] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-03f7a97c-14e5-4707-a109-e07660e131ff taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.372249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.372364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.372543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.372628] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.372764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.372826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.372968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.373091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.373193] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.374323] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa53f5f6-1645-4a7a-a879-a0a5795e1237 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.374531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.374531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.374665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.374741] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa53f5f6-1645-4a7a-a879-a0a5795e1237',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.484195] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 690.484413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.789831] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 690.790124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.790370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.790638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.790759] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.877869] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-03f7a97c-14e5-4707-a109-e07660e131ff taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.878574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.878802] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.879776] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa53f5f6-1645-4a7a-a879-a0a5795e1237 with status ACTIVE [ 690.879997] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.880145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.880213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.880415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.880509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.880766] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.880878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.880925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.882881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.882985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.883214] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.883313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.883480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.883538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.883662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.883710] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa53f5f6-1645-4a7a-a879-a0a5795e1237 is going to be updated. [ 690.906078] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.906078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.906078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.906078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.906078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.906078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa53f5f6-1645-4a7a-a879-a0a5795e1237" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.265454] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 691.265687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.265851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.266084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.266267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.266384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.266447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.266602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.266687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.266782] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.268172] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 691.268386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.268491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.268646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.268801] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.268902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.268953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.269105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.269182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.269267] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.293397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.293397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.386289] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.771987] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.773268] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.894262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.894262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.894262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.894262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.894262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.894262] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03f7a97c-14e5-4707-a109-e07660e131ff is going to be created. [ 691.918042] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.918042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.918042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.918042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.918042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.932236] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03f7a97c-14e5-4707-a109-e07660e131ff in Status: UNINITIALIZED for 2s [ 691.934025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: SUCCESS [ 691.934025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.200476] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fe87bdc2-7fa4-4617-bd52-29a34d448d7c tempest-MigrationsAdminTest-1148431189 tempest-MigrationsAdminTest-1148431189-project-member] Enqueued Resource ID: 23540fd9-b693-40f4-ad77-d11a5c936845 with Priority: HIGHEST for action security_group_rules [ 692.204058] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540fd9-b693-40f4-ad77-d11a5c936845 with Priority: HIGHEST for action security_group_rules [ 692.204058] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23540fd9-b693-40f4-ad77-d11a5c936845 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.204058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.204058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.204058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.204058] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23540fd9-b693-40f4-ad77-d11a5c936845',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.274132] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.279957] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.302494] env[70287]: INFO networking_nsxv3.common.synchronization [None req-9c941ad8-e6e2-4b54-97c1-6cd96aabb862 tempest-MigrationsAdminTest-1148431189 tempest-MigrationsAdminTest-1148431189-project-member] Enqueued Resource ID: 23540fd9-b693-40f4-ad77-d11a5c936845 with Priority: HIGHEST for action security_group_rules [ 692.303070] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23540fd9-b693-40f4-ad77-d11a5c936845 with Priority: HIGHEST for action security_group_rules [ 692.303303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23540fd9-b693-40f4-ad77-d11a5c936845 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.303463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.722688] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.722906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.722993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.723238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.723332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.723431] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23540fd9-b693-40f4-ad77-d11a5c936845 already deleted. [ 692.723515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.723673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.723857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.723924] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23540fd9-b693-40f4-ad77-d11a5c936845',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.776908] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.778692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.778692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.778692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.778692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.778692] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 692.783462] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.783617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.783695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.783905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.783995] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.784125] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be updated. [ 692.804535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.804707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.804784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.805041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.805195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.807450] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.807565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.807655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.807808] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.807928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.818260] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 692.819429] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: IN_PROGRESS for 2s [ 693.248057] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.248360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.248360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.248496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.248582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.248675] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23540fd9-b693-40f4-ad77-d11a5c936845 already deleted. [ 693.248752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23540fd9-b693-40f4-ad77-d11a5c936845" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.941608] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03f7a97c-14e5-4707-a109-e07660e131ff in Status: SUCCESS [ 693.941608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.941608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.941608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.941608] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.941993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.941993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.941993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.941993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.941993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.942227] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.949590] env[70287]: INFO networking_nsxv3.common.synchronization [req-ae50264e-f639-4d23-a4d8-079bff41c05c req-78f0208b-ba31-4276-9d47-770c04d5e832 tempest-ServerGroupTestJSON-49991975 tempest-ServerGroupTestJSON-49991975-project-member] Enqueued Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_members [ 693.949590] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d with Priority: HIGHEST for action security_group_members [ 693.949590] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3e02cb19-0821-42f3-a922-f67afc4bab0d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.949590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.949590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.949590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.949590] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.949590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.949590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.949590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.949590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.949590] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3e02cb19-0821-42f3-a922-f67afc4bab0d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.236048] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-4702e015-7724-4e64-9581-7d2ce02ca337 tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 694.236260] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 694.237146] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.237146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.237146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.237395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.237551] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.237648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.237709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.237945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.238109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.238464] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.444382] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-03f7a97c-14e5-4707-a109-e07660e131ff taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.444774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.444774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.445104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.445368] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.445547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.445594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.445766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.445875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.445971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.446150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-03f7a97c-14e5-4707-a109-e07660e131ff taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.446262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.446327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.446471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.446625] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.446731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.446798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.446942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.449673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.449822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.449928] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.451672] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.451861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.451910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.452317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.452317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.452317] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.452504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.452504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.452625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.452703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.452807] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d is going to be updated. [ 694.480519] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.480683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.481544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.483740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.483740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.491194] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d in Status: IN_PROGRESS for 2s [ 694.657822] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-386 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.658046] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.658179] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.658492] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.659793] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.659793] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.659793] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.659793] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.659793] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.659793] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.659793] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 694.659793] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 694.660094] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 694.660094] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 694.660094] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 694.660171] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 694.681807] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 694.681807] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 694.681807] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 694.681807] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.681807] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-875874d4-b218-4c3a-935c-74dcd091f5e1 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.681807] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.681807] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.681807] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.681807] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('875874d4-b218-4c3a-935c-74dcd091f5e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.740799] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.741011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.741116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.741490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.741592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.741901] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.742073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.742269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.742404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.742512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.742631] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 already deleted. [ 694.742759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.831173] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 694.831506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.831692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.831893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.832309] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.832463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.832528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.833459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.833459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.833459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.833459] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.839622] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 694.839835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.840764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.841043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.841256] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.841445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.841551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.841751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.841963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.841963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.842276] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.842276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.842441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.842441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.842569] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.842663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.842789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.842918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.843122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.843122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.843325] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.954403] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 03f7a97c-14e5-4707-a109-e07660e131ff: rpc.has_security_group_logging(os_id): False [ 694.976455] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.976455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.976783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.976783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.976959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.977459] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.977459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.977459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.977701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.977749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.978012] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.978194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.978276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.978491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.978591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.978893] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.979105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.979166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.979372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.979524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.979649] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 03f7a97c-14e5-4707-a109-e07660e131ff is going to be created. [ 695.040854] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.041016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.041088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.041311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.041494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.055161] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03f7a97c-14e5-4707-a109-e07660e131ff in Status: IN_PROGRESS for 2s [ 695.183555] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.183874] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.184073] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.184454] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.185193] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.185193] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 875874d4-b218-4c3a-935c-74dcd091f5e1 not found, creating... [ 695.185440] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.185517] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.185671] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.185983] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.186203] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.186612] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.186834] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.187018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.187312] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.187503] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.187697] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 875874d4-b218-4c3a-935c-74dcd091f5e1 is going to be created. [ 695.216643] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.217593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.217593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.217593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.218018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.218349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.341107] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.346662] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e57bed-6bad-4f87-86dc-05486c964c31: rpc.has_security_group_logging(os_id): False [ 695.365544] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.365706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.365755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.365969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.366068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.366261] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.367071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.367071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.367071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.367071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.367071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.367071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.367361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.367361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.367452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.367660] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.367747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.367800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.367970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.368087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.368162] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 695.442081] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.442358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.442477] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.443306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.443589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.454956] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 695.845435] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33f97a48-67cf-4681-a4ae-50c22c693573: rpc.has_security_group_logging(os_id): False [ 695.863963] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.864158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.864197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.864414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.864515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.864747] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.864841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.864905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.865106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.865204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.865296] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be updated. [ 695.951268] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.951476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.951550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.951775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.951925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.967841] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-b6c2906d-b39c-41d3-b1ca-ea902b4f6f58 service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 695.968032] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-b6c2906d-b39c-41d3-b1ca-ea902b4f6f58 service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 695.968175] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-b6c2906d-b39c-41d3-b1ca-ea902b4f6f58 service nova] Enqueued Resource ID: 875874d4-b218-4c3a-935c-74dcd091f5e1 with Priority: HIGHEST for action port [ 695.968398] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 695.968523] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 695.968617] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 875874d4-b218-4c3a-935c-74dcd091f5e1 with Priority: HIGHEST for action port [ 695.969244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.969374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.969438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.970683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.970683] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.971121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.971395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.973041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.973041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.973041] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.973041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.973041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.973041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.973041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.973041] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.973041] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-875874d4-b218-4c3a-935c-74dcd091f5e1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.973416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.973416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.973416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.973541] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('875874d4-b218-4c3a-935c-74dcd091f5e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.974928] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: IN_PROGRESS for 2s [ 696.475630] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.475941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.476066] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.477396] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 875874d4-b218-4c3a-935c-74dcd091f5e1 with status ACTIVE [ 696.477653] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.477797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.477896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.478113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.478297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.478619] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.478795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.478913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.479691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.479835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.480782] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.480782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.480782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.481018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.481197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.481293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 875874d4-b218-4c3a-935c-74dcd091f5e1 is going to be updated. [ 696.499829] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d in Status: SUCCESS [ 696.500074] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3e02cb19-0821-42f3-a922-f67afc4bab0d deletion is rescheduled due to dependency. [ 696.500221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3e02cb19-0821-42f3-a922-f67afc4bab0d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.503805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.503958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.504062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.504261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.504458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.504620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-875874d4-b218-4c3a-935c-74dcd091f5e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.986900] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.066155] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 03f7a97c-14e5-4707-a109-e07660e131ff in Status: SUCCESS [ 697.066413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.468481] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 697.468739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.468973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.469252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.469551] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.489299] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.489631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.489631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.489736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.489848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.489946] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be created. [ 697.532221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.532366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.532456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.532731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.533071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.544513] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: UNINITIALIZED for 2s [ 697.978877] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.978877] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.978877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.978877] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.993036] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 697.993036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.484852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.484852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.484852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.484852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.484852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.485675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.485675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.485675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.485675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.485675] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.526372] env[70287]: INFO networking_nsxv3.common.synchronization [req-5518bc63-7f50-47dc-a1a8-c6699cdf6df2 req-1680681b-8152-4bc7-b36a-af747f3c6803 tempest-ListImageFiltersTestJSON-688226099 tempest-ListImageFiltersTestJSON-688226099-project-member] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 698.526372] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 698.529432] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.529432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.529432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.529432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.529432] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.529432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.529432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.529432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.529432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.529432] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.751623] env[70287]: INFO networking_nsxv3.common.synchronization [req-82d5de76-f6ed-4a8c-a05e-f5ffb32a3fac req-65909e5d-345b-4af3-9656-05b104e7c87a tempest-ServersAdminNegativeTestJSON-1153260158 tempest-ServersAdminNegativeTestJSON-1153260158-project-member] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 698.752611] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGHEST for action security_group_members [ 698.754666] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.754977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.756721] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.756721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.756721] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.990140] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e57bed-6bad-4f87-86dc-05486c964c31: rpc.has_security_group_logging(os_id): False [ 699.008025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.008179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.009025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.009025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.009025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.009025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.009025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.009025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.009420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.009420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.009420] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.009649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.009649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.009722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.009767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.009930] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.010063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.010118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.010247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.010309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.010395] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 699.036985] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.075354] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.075567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.075567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.075814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.075967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.097620] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 699.243867] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-40a0a815-7510-41c7-9036-7c15383e939e tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 699.244454] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 699.244803] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.244917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.259484] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.259484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.259484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.259783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.260243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.260243] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.260243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.260243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.261153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.261153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.261153] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be updated. [ 699.298190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.298408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.298408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.298610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.298745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.319627] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: IN_PROGRESS for 2s [ 699.543408] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.553778] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 699.554018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.554270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.554407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.554601] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.554729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.554799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.554951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.555048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.555136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.555234] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.557156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.557390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.557505] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.557615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.557668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.557814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.557902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.557983] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.605234] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-386 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.605449] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.605576] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.605925] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.606170] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.606268] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.606404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.606594] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.606729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.606939] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.607074] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.607183] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.607289] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.607395] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 699.607600] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.611107] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.625029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.625029] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.016 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 699.625029] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.625029] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.625029] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.625029] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.625029] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.625548] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.625548] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a948b9c7-2d7d-41eb-a890-3e162fbe5a6d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.046460] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.046460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.046460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.046765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.046765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.046877] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 is going to be updated. [ 700.060045] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.060130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.060282] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.072317] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.072401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.072436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.072667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.072857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.082139] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: IN_PROGRESS for 2s [ 700.130214] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.130707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.130858] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.131749] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.131749] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.131749] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port a948b9c7-2d7d-41eb-a890-3e162fbe5a6d not found, creating... [ 700.132107] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.132259] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.132431] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.132765] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.132943] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.133297] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.133551] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.133725] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.133982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.134178] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.134427] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: a948b9c7-2d7d-41eb-a890-3e162fbe5a6d is going to be created. [ 700.162081] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.162344] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.162463] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.163058] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.163149] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.163317] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.562641] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.915929] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-f3509db3-11ec-4674-9cca-fc1673139349 service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 700.916331] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-f3509db3-11ec-4674-9cca-fc1673139349 service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 700.916542] env[70287]: INFO networking_nsxv3.common.synchronization [req-58a89df4-6387-4bf9-97d0-4f3d124257ad req-f3509db3-11ec-4674-9cca-fc1673139349 service nova] Enqueued Resource ID: a948b9c7-2d7d-41eb-a890-3e162fbe5a6d with Priority: HIGHEST for action port [ 700.917154] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 700.917386] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 700.917531] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a948b9c7-2d7d-41eb-a890-3e162fbe5a6d with Priority: HIGHEST for action port [ 700.917847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.918237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.918237] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.918409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.918672] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.918754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.918838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.919148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.919290] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a948b9c7-2d7d-41eb-a890-3e162fbe5a6d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.065241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.065401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.065494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.065745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.065874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.066035] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 701.101225] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.101225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.104129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.104404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.104560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.114966] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 701.115793] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 701.116086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.122234] env[70287]: INFO networking_nsxv3.common.synchronization [req-5928899c-b1ff-49d0-9906-c0adde0ff774 req-871b16b4-2d17-4e72-9c9c-30932939dc5e tempest-ServerAddressesTestJSON-1917547805 tempest-ServerAddressesTestJSON-1917547805-project-member] Enqueued Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_members [ 701.124242] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03f7a97c-14e5-4707-a109-e07660e131ff with Priority: HIGHEST for action security_group_members [ 701.125035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-03f7a97c-14e5-4707-a109-e07660e131ff taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.125035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.125035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.125035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.125035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.125342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.125342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.125342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.125342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.125701] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('03f7a97c-14e5-4707-a109-e07660e131ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.329019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6d080df-987c-42ee-a1c4-0bd34532e799 in Status: SUCCESS [ 701.329019] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 deletion is rescheduled due to dependency. [ 701.329019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.424365] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a948b9c7-2d7d-41eb-a890-3e162fbe5a6d with status ACTIVE [ 701.424601] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.424743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.424813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.425048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.425148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.425337] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.425439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.425492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.425643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.425724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.425897] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.425989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.426054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.426193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.426268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.426371] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a948b9c7-2d7d-41eb-a890-3e162fbe5a6d is going to be updated. [ 701.445498] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.445604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.445604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.445806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.446142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.446452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a948b9c7-2d7d-41eb-a890-3e162fbe5a6d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.627895] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.628306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.628306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.628501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.628607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.628830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.628939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.629072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.629186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.629264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.629371] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03f7a97c-14e5-4707-a109-e07660e131ff is going to be updated. [ 701.653728] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.653987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.654148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.654421] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.654556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.662146] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03f7a97c-14e5-4707-a109-e07660e131ff in Status: IN_PROGRESS for 2s [ 701.900289] env[70287]: INFO networking_nsxv3.common.synchronization [req-cc689223-109d-4f89-9e5f-5599a7b6cd41 req-7168a445-2997-4318-9552-3ace8779ac52 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 701.901183] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 701.901708] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.902625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.902625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.902625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.902890] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.903117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.903262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.903529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.903695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.903882] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.091935] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: SUCCESS [ 702.092205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.371505] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.371660] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.371780] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.372136] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.372392] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.372546] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.375333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.375333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.375333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.375333] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.375333] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 702.375333] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 702.375333] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 702.375333] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 702.375333] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 702.375333] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 702.391712] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 702.391988] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 702.392269] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 702.392564] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.393122] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-d32ac947-4c90-4536-ace0-df2434cae72a taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.393400] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.393613] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.396406] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.396406] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d32ac947-4c90-4536-ace0-df2434cae72a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.408625] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.408625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.408625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.408625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.408625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.408625] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.409052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.409052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.409052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.409052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.409052] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 already deleted. [ 702.409234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.901182] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.901182] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port d32ac947-4c90-4536-ace0-df2434cae72a not found, creating... [ 702.901182] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.901182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.901786] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.901786] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.901786] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.902236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.902515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.902770] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: d32ac947-4c90-4536-ace0-df2434cae72a is going to be created. [ 702.922835] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.923016] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.923110] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.923396] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.923624] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.923846] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.126405] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 4s [ 703.299052] env[70287]: INFO networking_nsxv3.common.synchronization [req-afa75d15-79d9-4fe4-b165-6dda184d67d4 req-24e869b0-6157-4f6d-800c-a88cfeab75f5 tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 703.299618] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 703.300070] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.301281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.301386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.301729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.302014] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.305158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.305232] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.305417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.305519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.305677] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.675616] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 03f7a97c-14e5-4707-a109-e07660e131ff in Status: SUCCESS [ 703.675807] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 03f7a97c-14e5-4707-a109-e07660e131ff deletion is rescheduled due to dependency. [ 703.675922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-03f7a97c-14e5-4707-a109-e07660e131ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.718200] env[70287]: INFO networking_nsxv3.common.synchronization [req-cc689223-109d-4f89-9e5f-5599a7b6cd41 req-471e3eba-780b-4f98-a6d3-0914bb5edbdc service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 703.718369] env[70287]: INFO networking_nsxv3.common.synchronization [req-cc689223-109d-4f89-9e5f-5599a7b6cd41 req-471e3eba-780b-4f98-a6d3-0914bb5edbdc service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 703.718547] env[70287]: INFO networking_nsxv3.common.synchronization [req-cc689223-109d-4f89-9e5f-5599a7b6cd41 req-471e3eba-780b-4f98-a6d3-0914bb5edbdc service nova] Enqueued Resource ID: d32ac947-4c90-4536-ace0-df2434cae72a with Priority: HIGHEST for action port [ 703.718731] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 703.718855] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 703.719012] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32ac947-4c90-4536-ace0-df2434cae72a with Priority: HIGHEST for action port [ 703.719506] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.719629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.719697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.719963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.720167] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.721211] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.721211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.721211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.721562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.721562] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.721669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.721669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.721777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.721938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.722037] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.723106] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d32ac947-4c90-4536-ace0-df2434cae72a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.723235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.723307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.723487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.723538] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d32ac947-4c90-4536-ace0-df2434cae72a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.808264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.808264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.808585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.808907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.809034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.809270] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.809366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.809404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.809555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.809646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.813021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 703.836493] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.836700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.837637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.837637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.837637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.846344] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 704.230025] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.230025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.230025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d32ac947-4c90-4536-ace0-df2434cae72a with status ACTIVE [ 704.230025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.230025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.230025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.230945] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.230945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.230945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.230945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.230945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.230945] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d32ac947-4c90-4536-ace0-df2434cae72a is going to be updated. [ 704.252397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.252543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.252612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.252809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.253021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.253176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d32ac947-4c90-4536-ace0-df2434cae72a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.734260] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.790764] env[70287]: INFO networking_nsxv3.common.synchronization [req-0095ff8b-19e0-454b-b803-eef8f74e959c req-63dde3d8-28e9-4f6d-9b00-fce411470693 tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 704.791622] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 704.792055] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.792292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.792399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.792669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.794309] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.795620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.795620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.795620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.795620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.795620] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.136264] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 705.136477] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.136635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.136848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.137047] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.137160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.138174] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.138174] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.138174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.138678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.138678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.138678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.138678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.138678] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.142109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.142109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.142109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.142109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.142109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.142109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.142109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.142109] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.239292] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.239756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.239756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.239944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.240050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.240151] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be created. [ 705.262684] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.262684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.262684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.262684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.262684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.271514] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: UNINITIALIZED for 2s [ 705.300415] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.300543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.300639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.300894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.300991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.301206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.301309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.301371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.301527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.301604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.301693] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 705.357756] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.357756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.357756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.357756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.357756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.372751] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 705.645999] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d87c2dce-8258-430c-b549-6c6bfe5f0943: rpc.has_security_group_logging(os_id): False [ 705.645999] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.662174] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.662418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.662418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.662626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.662720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.663096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.663096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.663096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.663302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.663335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.663585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.663752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.663752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.663908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.664141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.664283] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.664391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.664468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.664627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.664774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.664825] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be created. [ 705.733108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.733108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.733234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.733387] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.733582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.744094] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 705.860284] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 705.860471] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 deletion is rescheduled due to dependency. [ 705.860614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.147932] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.649993] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.650316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.650354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.650682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.650895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.650998] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 706.675949] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.676108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.676167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.676381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.676534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.685399] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 707.281972] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 707.282250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.282447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.282664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.282892] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.283021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.283082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.283236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.283317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.283400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.283494] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.381983] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 707.382229] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 deletion is rescheduled due to dependency. [ 707.382374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.754800] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 707.755150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.755545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.755793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.755878] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.787036] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.787036] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.787036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.787540] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.787540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.787540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.787540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.787654] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.787654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.787716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.787947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.787947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.788040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.788075] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.262731] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.262977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.290711] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1f591-bba8-479c-a2de-cf9524dceb77: rpc.has_security_group_logging(os_id): False [ 708.307085] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.307085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.307085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.307282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.307375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.307580] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.307681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.307745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.307891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.308036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.308188] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.308239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.308383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.308444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.308507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.308671] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.308760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.308821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.308957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.309050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.309133] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be created. [ 708.366450] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.366601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.366665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.366873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.367066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.376091] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 708.693868] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 708.694157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.694326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.694544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.694735] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.694850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.694908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.695070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.695272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.695450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.695547] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.792339] env[70287]: INFO networking_nsxv3.common.synchronization [req-62c1dcf2-4d79-4924-a24a-c42ac70860a3 req-7e7c53ab-fb7e-46b6-abdd-c2e01d6f5ca0 tempest-ServersTestBootFromVolume-1362117415 tempest-ServersTestBootFromVolume-1362117415-project-member] Enqueued Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_members [ 708.792918] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGHEST for action security_group_members [ 708.793237] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.793369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.793436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.793629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.793776] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.793922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.793991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.794758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.795803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.795938] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.197737] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.197916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.197988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.198362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.198533] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.198665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.198752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.198933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.199156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.199156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.199327] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.199458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.199539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.199706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.199870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.199990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.200080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.200243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.200661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.200817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.200869] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.298886] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.299017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.299765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.299765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.299765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.299921] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.299989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.300057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.300284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.300457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.300513] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e is going to be updated. [ 709.325868] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.326072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.326154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.326374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.326519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.335145] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e in Status: IN_PROGRESS for 2s [ 709.703434] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d87c2dce-8258-430c-b549-6c6bfe5f0943: rpc.has_security_group_logging(os_id): False [ 709.720411] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.720552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.720643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.721996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.721996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.721996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.722483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.722483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.722483] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.723340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.723340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.723340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.723340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.723340] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 709.782411] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.782655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.782721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.783021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.786531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.795515] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 710.390053] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 710.390053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.344487] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e in Status: SUCCESS [ 711.344843] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e deletion is rescheduled due to dependency. [ 711.344879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.807654] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 711.807906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.988919] env[70287]: INFO networking_nsxv3.common.synchronization [req-6c6b5e0e-0823-46fe-9730-8cdc69c91154 req-e44b6e97-09cd-4cac-a66a-5d49a7798755 tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 711.988919] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 711.988919] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.988919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.988919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.989357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.989357] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.989357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.989357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.989485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.989566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.989657] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.104463] env[70287]: INFO networking_nsxv3.common.synchronization [req-6e3a2036-c2df-49f9-bfcc-a746c9b8702c req-97b6d924-48c9-4844-af5a-0b6e2a3942c3 tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 712.105017] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 712.105325] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.105429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.492159] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.996014] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.497101] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.497101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.497101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.497452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.497649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.497649] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 713.540571] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.540731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.540812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.541012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.541153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.550858] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 715.056439] env[70287]: INFO networking_nsxv3.common.synchronization [req-470f0000-55b9-4b1d-8b10-20d6a8d2d265 req-3282be80-efd3-4d3c-8a25-73e007a558b8 tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 715.056974] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 715.057286] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.057599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.057599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.057799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.058015] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.058015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.058107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.058297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.058297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.058406] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.543249] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.543436] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.543572] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.543939] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.546142] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.546142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.546142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.546142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.546142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.547725] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.548432] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 715.548597] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 715.548742] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 715.548831] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 715.548940] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 715.549093] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 715.559988] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.560192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.560261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.560454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.563268] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.563268] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 already deleted. [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.563268] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.563268] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.563268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.564850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.564850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.564850] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.570083] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 715.570241] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 715.570376] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 715.570537] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.570858] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-bcc2f2fe-98d9-4919-83e7-c8314afb636f taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.571027] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.571140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.572383] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.572866] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcc2f2fe-98d9-4919-83e7-c8314afb636f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.066333] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.066642] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.066642] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.066762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.066853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.067063] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.067162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.067227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.067375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.067451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.067538] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 716.074915] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.075124] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.075254] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.075527] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.075674] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.075822] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port bcc2f2fe-98d9-4919-83e7-c8314afb636f not found, creating... [ 716.076107] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.076341] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.076389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.076600] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.076736] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.077019] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.077177] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.077295] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.077497] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.078101] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.078399] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: bcc2f2fe-98d9-4919-83e7-c8314afb636f is going to be created. [ 716.095020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.095020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.095020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.095020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.095020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.097347] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.097522] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.097641] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.097878] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.098099] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.098297] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.107131] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 716.840946] env[70287]: INFO networking_nsxv3.common.synchronization [req-470f0000-55b9-4b1d-8b10-20d6a8d2d265 req-adef8a3b-2fcb-4d9b-96d9-6a8096bd48b1 service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 716.841097] env[70287]: INFO networking_nsxv3.common.synchronization [req-470f0000-55b9-4b1d-8b10-20d6a8d2d265 req-adef8a3b-2fcb-4d9b-96d9-6a8096bd48b1 service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 716.841235] env[70287]: INFO networking_nsxv3.common.synchronization [req-470f0000-55b9-4b1d-8b10-20d6a8d2d265 req-adef8a3b-2fcb-4d9b-96d9-6a8096bd48b1 service nova] Enqueued Resource ID: bcc2f2fe-98d9-4919-83e7-c8314afb636f with Priority: HIGHEST for action port [ 716.841481] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 716.841612] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 716.841737] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcc2f2fe-98d9-4919-83e7-c8314afb636f with Priority: HIGHEST for action port [ 716.843185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.843185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.843185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.843185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.843185] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.844494] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.845211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.845211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.845211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.845211] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.845211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.845211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.845499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.845499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.845563] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.846506] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcc2f2fe-98d9-4919-83e7-c8314afb636f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.846622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.846688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.847563] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.847563] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcc2f2fe-98d9-4919-83e7-c8314afb636f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.352021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.352021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.352021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcc2f2fe-98d9-4919-83e7-c8314afb636f with status ACTIVE [ 717.352021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.352021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.352021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.352767] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.352767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.352767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.352767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.352767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.352767] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcc2f2fe-98d9-4919-83e7-c8314afb636f is going to be updated. [ 717.376129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.376283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.376283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.376687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.376687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.376761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcc2f2fe-98d9-4919-83e7-c8314afb636f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.491105] env[70287]: INFO networking_nsxv3.common.synchronization [req-5ce2c1b1-3615-44df-9fe0-52b2c99735c2 req-40e88a86-ca7d-4fb9-8202-e339eb404086 tempest-DeleteServersAdminTestJSON-1239410168 tempest-DeleteServersAdminTestJSON-1239410168-project-member] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 717.491105] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 717.491105] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.491105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.491105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.491105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.491105] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.491105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.491105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.491940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.492288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.492642] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.851701] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.948931] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.952490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.952490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.952490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.952490] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.952490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.952490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.952490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.952490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.952490] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.952490] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 717.952490] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 717.952490] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 717.953513] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 717.953513] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 717.953513] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.972219] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.972506] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 717.972702] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.973012] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.973416] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-4e6c139f-fe26-4f9e-a217-1def72ae7b12 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.973611] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.973731] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.974096] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.974240] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e6c139f-fe26-4f9e-a217-1def72ae7b12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.995343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.995515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.995584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.995782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.995872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.996082] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.996177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.996255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.996713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.996713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.996800] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 is going to be updated. [ 718.021185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.021185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.021327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.021442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.021583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.030637] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: IN_PROGRESS for 2s [ 718.115901] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 718.116122] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 deletion is rescheduled due to dependency. [ 718.116237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.355019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.355300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.355348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.355556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.355694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.355789] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be created. [ 718.378171] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.378340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.378412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.378620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.378786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.387528] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: UNINITIALIZED for 2s [ 718.477523] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.477906] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.478100] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.478472] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.478690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.478993] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 4e6c139f-fe26-4f9e-a217-1def72ae7b12 not found, creating... [ 718.479234] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.479403] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.479522] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.479808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.479971] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.480275] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.480431] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.480548] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.480757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.480953] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.481162] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 4e6c139f-fe26-4f9e-a217-1def72ae7b12 is going to be created. [ 718.501318] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.501495] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.501607] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.501816] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.502055] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.502392] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.231273] env[70287]: INFO networking_nsxv3.common.synchronization [req-5ce2c1b1-3615-44df-9fe0-52b2c99735c2 req-9bc8f367-eede-4269-923b-96b6244336a4 service nova] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_rules [ 719.231273] env[70287]: INFO networking_nsxv3.common.synchronization [req-5ce2c1b1-3615-44df-9fe0-52b2c99735c2 req-9bc8f367-eede-4269-923b-96b6244336a4 service nova] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 719.231273] env[70287]: INFO networking_nsxv3.common.synchronization [req-5ce2c1b1-3615-44df-9fe0-52b2c99735c2 req-9bc8f367-eede-4269-923b-96b6244336a4 service nova] Enqueued Resource ID: 4e6c139f-fe26-4f9e-a217-1def72ae7b12 with Priority: HIGHEST for action port [ 719.231273] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_rules [ 719.231273] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 719.231273] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e6c139f-fe26-4f9e-a217-1def72ae7b12 with Priority: HIGHEST for action port [ 719.231273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.231645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.231958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.232372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.232550] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.233851] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.234112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.234400] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e6c139f-fe26-4f9e-a217-1def72ae7b12 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.237469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.237469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.237469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.237619] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e6c139f-fe26-4f9e-a217-1def72ae7b12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.739938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.740239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.740239] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e6c139f-fe26-4f9e-a217-1def72ae7b12 with status ACTIVE [ 719.740517] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.740517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.740608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.740779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.740896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.741037] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.741125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.741192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.741345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.741423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.741598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.741690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.741752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.741963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.742036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.742096] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e6c139f-fe26-4f9e-a217-1def72ae7b12 is going to be updated. [ 719.761716] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.761840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.761938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.762116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.762246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.762406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e6c139f-fe26-4f9e-a217-1def72ae7b12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.042316] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: SUCCESS [ 720.042316] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 deletion is rescheduled due to dependency. [ 720.042316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.042316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.042316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.042316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.042316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.042316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.042316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.042316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.042316] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.121535] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f90d3689-36d3-450f-864b-4847eddb09e1 None None] Enqueued Resource ID: 2e17e5cf-fff5-4c64-b8ea-16cb950c035f with Priority: HIGHEST for action port [ 720.122153] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e17e5cf-fff5-4c64-b8ea-16cb950c035f with Priority: HIGHEST for action port [ 720.122567] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e17e5cf-fff5-4c64-b8ea-16cb950c035f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.122779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e17e5cf-fff5-4c64-b8ea-16cb950c035f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.123503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e17e5cf-fff5-4c64-b8ea-16cb950c035f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.123503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e17e5cf-fff5-4c64-b8ea-16cb950c035f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.123503] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e17e5cf-fff5-4c64-b8ea-16cb950c035f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.205628] env[70287]: INFO networking_nsxv3.common.synchronization [req-aa154028-37b9-4905-ada3-92439edd731e req-bbf2d227-2ea8-4c9e-86d1-a042151bea75 tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 720.205844] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 720.206161] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.206275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.400749] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 720.401224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.402754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.402754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.402754] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.402911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.403091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.403441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.403586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.403754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.403936] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.406031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.406106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.406368] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.406570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.406720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.406939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.407238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.407238] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.551110] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.563552] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.565561] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.565696] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.566493] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.567664] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.567917] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.569459] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.569749] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.569884] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.570107] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.570225] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 720.570429] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 720.570429] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 720.574019] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 720.574019] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 720.574019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 720.619037] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 720.619037] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 720.619037] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 720.619037] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.621296] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f3ec022f-3bb0-4e04-abd5-14df56407484 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.621480] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.621606] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.621930] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.622085] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ec022f-3bb0-4e04-abd5-14df56407484',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.627524] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e17e5cf-fff5-4c64-b8ea-16cb950c035f [ 720.627524] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.627524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.627524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.627524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.627524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.627524] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e17e5cf-fff5-4c64-b8ea-16cb950c035f already deleted. [ 720.627524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e17e5cf-fff5-4c64-b8ea-16cb950c035f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.911751] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.912701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.912822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.055447] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.124918] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.124918] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.124918] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.127800] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.128054] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.128281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f3ec022f-3bb0-4e04-abd5-14df56407484 not found, creating... [ 721.128804] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.129445] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.129445] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.130965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.130965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.130965] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.130965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.130965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.130965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.130965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.130965] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f3ec022f-3bb0-4e04-abd5-14df56407484 is going to be created. [ 721.151717] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.151954] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.152113] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.152457] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.152684] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.152907] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.414267] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.562369] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.562369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.562369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.562646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.562646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.562646] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 is going to be updated. [ 721.596402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.596402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.596402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.596402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.596402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.604515] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: IN_PROGRESS for 2s [ 721.887193] env[70287]: INFO networking_nsxv3.common.synchronization [req-aa154028-37b9-4905-ada3-92439edd731e req-1cec181d-6228-4d1a-8cb3-5c58abd08cb0 service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 721.887193] env[70287]: INFO networking_nsxv3.common.synchronization [req-aa154028-37b9-4905-ada3-92439edd731e req-1cec181d-6228-4d1a-8cb3-5c58abd08cb0 service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 721.887193] env[70287]: INFO networking_nsxv3.common.synchronization [req-aa154028-37b9-4905-ada3-92439edd731e req-1cec181d-6228-4d1a-8cb3-5c58abd08cb0 service nova] Enqueued Resource ID: f3ec022f-3bb0-4e04-abd5-14df56407484 with Priority: HIGHEST for action port [ 721.887770] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 721.887770] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 721.888129] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ec022f-3bb0-4e04-abd5-14df56407484 with Priority: HIGHEST for action port [ 721.888431] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.890175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.890175] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.890175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.890175] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3ec022f-3bb0-4e04-abd5-14df56407484 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.890175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.890175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.890175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.890980] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3ec022f-3bb0-4e04-abd5-14df56407484',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.917713] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.918013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.918051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.918316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.918457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.919109] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 721.945245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.945481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.945481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.945670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.945810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.953408] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 722.397020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f3ec022f-3bb0-4e04-abd5-14df56407484 with status ACTIVE [ 722.397020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.397020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.397020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.397020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.397020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f3ec022f-3bb0-4e04-abd5-14df56407484 is going to be updated. [ 722.415893] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.415893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.415893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.415893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.415893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.415893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3ec022f-3bb0-4e04-abd5-14df56407484" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.576630] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ecbc5435-eb06-4921-a1cf-1a262ed95b67 None None] Enqueued Resource ID: cc5b78e3-735c-4870-a6ff-9f416688d3fe with Priority: HIGHEST for action port [ 722.577551] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc5b78e3-735c-4870-a6ff-9f416688d3fe with Priority: HIGHEST for action port [ 722.577647] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc5b78e3-735c-4870-a6ff-9f416688d3fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.577757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc5b78e3-735c-4870-a6ff-9f416688d3fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.577820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc5b78e3-735c-4870-a6ff-9f416688d3fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.578126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc5b78e3-735c-4870-a6ff-9f416688d3fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.578216] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc5b78e3-735c-4870-a6ff-9f416688d3fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.041089] env[70287]: INFO networking_nsxv3.common.synchronization [req-8abd3207-7315-4d4b-ae4b-3471ca9b65bb req-b7c62f11-d643-4aa0-b3cd-cfb7a6d9e3fc tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 723.041682] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 723.041987] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.042129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.042196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.042454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.042619] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.042720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.046151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.047108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.047108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.047108] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.084908] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc5b78e3-735c-4870-a6ff-9f416688d3fe [ 723.084908] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.084908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.084908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.084908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.084908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.084908] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc5b78e3-735c-4870-a6ff-9f416688d3fe already deleted. [ 723.084908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc5b78e3-735c-4870-a6ff-9f416688d3fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.458049] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-382 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.458049] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-382" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.458049] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-382" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.458049] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-382" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.458049] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.458049] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.458049] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.458694] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.458923] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.459187] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.459281] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 723.460347] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 723.460347] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 723.460347] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 723.460347] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 723.460347] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 723.477456] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 723.477622] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 723.477761] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 723.477943] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-382" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.478271] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-dad11f87-7224-42d2-95d3-6caec8021731 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.478443] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.478565] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.478924] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.479033] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dad11f87-7224-42d2-95d3-6caec8021731',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.549264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.549438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.549530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.549726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.549819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.550032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.550137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.550194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.550346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.550423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.550509] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 already deleted. [ 723.550588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.614679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: SUCCESS [ 723.616222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.616222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.616384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.616543] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.616656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.616716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.616865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.616977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.617042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.617222] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.962641] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 723.962870] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.963090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.963320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.963516] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.963637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.963702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.963845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.963925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.964040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.964222] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.964310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.964360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.964505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.964650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.965602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.965602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.965602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.965602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.965602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.965602] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.965960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.966133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.966392] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.966392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.966552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.966552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.966664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.966710] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.982519] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.982734] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.982860] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.983185] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.983336] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.983491] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port dad11f87-7224-42d2-95d3-6caec8021731 not found, creating... [ 723.983750] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.983900] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.984026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.984254] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.984389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.984660] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.984810] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.984924] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.985163] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.985299] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.985462] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: dad11f87-7224-42d2-95d3-6caec8021731 is going to be created. [ 724.011245] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.011552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.011596] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.011882] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.012258] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.012592] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.120032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.120315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.120315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.120470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.120638] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.120741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.120801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.120962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.121076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.121187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.121335] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.121424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.121487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.121623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.121758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.121849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.121919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.122053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.122130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.122208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.122295] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.470533] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aafb90fc-938c-44be-9296-60863884f367: rpc.has_security_group_logging(os_id): False [ 724.470533] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.492107] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.492413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.492413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.492714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.493418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.493418] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.493418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.493418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.493611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.493611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.493748] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.493844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.493904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.494075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.494213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.497218] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.497218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.497218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.497218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.497218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.497218] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be created. [ 724.551404] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.551404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.551404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.551404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.551404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.561344] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 724.624914] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40: rpc.has_security_group_logging(os_id): False [ 724.626725] env[70287]: INFO networking_nsxv3.common.synchronization [req-1799284a-bf76-43a7-bad6-96e915ccb6c8 req-8ad7b85f-2aa7-406c-bebb-31732f6d96a6 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 724.627831] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 724.628565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.628748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.628860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.629171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.629306] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.629449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.629547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.630077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.630230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.630372] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.657549] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.657680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.657745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.658068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.658068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.658237] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.658389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.658389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.658531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.658604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.658779] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.658864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.658921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.659102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.659158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.659329] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.659417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.659475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.659611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.659679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.659759] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 is going to be updated. [ 724.737289] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.737465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.737537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.737742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.737919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.747606] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: IN_PROGRESS for 2s [ 724.976272] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.125295] env[70287]: INFO networking_nsxv3.common.synchronization [req-8abd3207-7315-4d4b-ae4b-3471ca9b65bb req-f0fb3b65-f209-419b-966f-a4eb931efe65 service nova] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 725.125542] env[70287]: INFO networking_nsxv3.common.synchronization [req-8abd3207-7315-4d4b-ae4b-3471ca9b65bb req-f0fb3b65-f209-419b-966f-a4eb931efe65 service nova] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 725.125636] env[70287]: INFO networking_nsxv3.common.synchronization [req-8abd3207-7315-4d4b-ae4b-3471ca9b65bb req-f0fb3b65-f209-419b-966f-a4eb931efe65 service nova] Enqueued Resource ID: dad11f87-7224-42d2-95d3-6caec8021731 with Priority: HIGHEST for action port [ 725.126127] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 725.126258] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 725.126392] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad11f87-7224-42d2-95d3-6caec8021731 with Priority: HIGHEST for action port [ 725.126658] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.126777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.126843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.131108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.131228] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.132146] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.132305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.132379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.132580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.132733] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.132874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.132960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.137030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.137030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.137030] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.137030] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-dad11f87-7224-42d2-95d3-6caec8021731 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.137030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.137030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.137030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.137030] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dad11f87-7224-42d2-95d3-6caec8021731',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.137790] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.137897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.137960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.139175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.139175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.139175] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.139175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.139175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.139175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.139175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.139175] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 725.165424] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.165569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.165654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.165904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.166064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.174509] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 725.479123] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.479284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.479352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.479586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.479680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.479775] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 725.507207] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.507352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.507422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.507798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.507798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.515902] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 725.638319] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.639033] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.639163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.640285] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dad11f87-7224-42d2-95d3-6caec8021731 with status ACTIVE [ 725.640457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.640572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.644021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.644021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.644021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.644021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dad11f87-7224-42d2-95d3-6caec8021731 is going to be updated. [ 725.661880] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.662032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.662115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.662318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.662447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.662599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.737474] env[70287]: INFO networking_nsxv3.common.synchronization [req-29940d7a-d61f-487f-843a-06f88384ba0a req-d9bb4390-f769-4574-9905-f19fea9e2fff tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_members [ 725.738155] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_members [ 725.739608] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.739608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.739608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.739608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.739608] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.739608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.739608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.739917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.739917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.739917] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.140864] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.165080] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.165280] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.165422] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.165750] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.168246] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.168493] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.168623] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.168869] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.169785] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.170094] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.170234] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 726.170359] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 726.170482] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 726.170608] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 726.170725] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 726.170873] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 726.204020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 726.204020] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 726.204020] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 726.204020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.204020] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.204020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.204020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.204020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.204020] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb9589a3-2c61-40e6-ad8b-d8ff59674adb',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.243354] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.243502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.244064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.244064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.244064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.244064] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.244260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.244260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.244370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.244446] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.244536] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c already deleted. [ 726.244614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.573140] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 726.573483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.573701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.573962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.574083] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.645923] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.645923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.645923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.645923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.645923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.645923] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be created. [ 726.674370] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.674370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.674626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.674663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.674805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.684593] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: UNINITIALIZED for 2s [ 726.705097] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.705367] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.705501] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.706057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.706057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.706296] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port fb9589a3-2c61-40e6-ad8b-d8ff59674adb not found, creating... [ 726.706890] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.706890] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.706890] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.707091] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.707175] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.707498] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.707660] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.707810] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.708079] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.708230] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.708376] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: fb9589a3-2c61-40e6-ad8b-d8ff59674adb is going to be created. [ 726.728128] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.728128] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.728128] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.728616] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.728752] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.728952] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.761607] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: SUCCESS [ 726.761607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.076531] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.076673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.193694] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 727.194023] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 727.194023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.449735] env[70287]: INFO networking_nsxv3.common.synchronization [req-29940d7a-d61f-487f-843a-06f88384ba0a req-67f3f61e-bce7-4ac9-8b6d-33dd51c1b2ec service nova] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_rules [ 727.449735] env[70287]: INFO networking_nsxv3.common.synchronization [req-29940d7a-d61f-487f-843a-06f88384ba0a req-67f3f61e-bce7-4ac9-8b6d-33dd51c1b2ec service nova] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_members [ 727.449735] env[70287]: INFO networking_nsxv3.common.synchronization [req-29940d7a-d61f-487f-843a-06f88384ba0a req-67f3f61e-bce7-4ac9-8b6d-33dd51c1b2ec service nova] Enqueued Resource ID: fb9589a3-2c61-40e6-ad8b-d8ff59674adb with Priority: HIGHEST for action port [ 727.449735] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_rules [ 727.449735] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_members [ 727.449930] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb9589a3-2c61-40e6-ad8b-d8ff59674adb with Priority: HIGHEST for action port [ 727.451538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.451538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.451538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.451538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.451538] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.451924] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.451924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.451924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.452202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.452202] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.452312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.452420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.452816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.452816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.452816] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.454784] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.454784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.454784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.454784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.454784] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb9589a3-2c61-40e6-ad8b-d8ff59674adb',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.528527] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 727.528754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.528931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.529173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.529386] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.529505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.529574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.530106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.530106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.530106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.530106] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.957793] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.958857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.958987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.959316] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb9589a3-2c61-40e6-ad8b-d8ff59674adb with status ACTIVE [ 727.959316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.959477] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.959538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.959695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.959781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.959983] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.960100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.960373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.960373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.962068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.962068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.962068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.962068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.962068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.962068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.962068] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb9589a3-2c61-40e6-ad8b-d8ff59674adb is going to be updated. [ 727.979712] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.979953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.979953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.980161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.980299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.980467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb9589a3-2c61-40e6-ad8b-d8ff59674adb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.035209] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.035209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.035474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.035474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.035676] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.035773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.035773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.035955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.035955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.036084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.036701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.036701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.036701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.036701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.036701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.036701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.037406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.037406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.037406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.037406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.037406] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.220189] env[70287]: INFO networking_nsxv3.common.synchronization [req-12655954-6309-4691-84ab-062553fbcdc3 req-216ef80b-fbde-456e-b6a2-730c824175be tempest-ServersV294TestFqdnHostnames-340574857 tempest-ServersV294TestFqdnHostnames-340574857-project-member] Enqueued Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_members [ 728.220794] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGHEST for action security_group_members [ 728.221236] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.221845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.221946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.222171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.222337] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.222441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.222500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.222658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.222771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.222844] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.462576] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.541410] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aafb90fc-938c-44be-9296-60863884f367: rpc.has_security_group_logging(os_id): False [ 728.568843] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.568996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.569085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.569311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.569406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.569603] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.569701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.569764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.569909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.569984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.570199] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.570295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.570355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.570499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.570573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.570745] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.571251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.571337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.571491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.571921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.571921] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 728.653774] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.653856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.653934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.654163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.654336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.665632] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 728.691754] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 728.691986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.692137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.692376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.692563] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.692678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.692741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.692893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.692979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.693116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.693194] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.727647] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.727647] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.727647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.727647] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a is going to be updated. [ 728.765567] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.765567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.765567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.765567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.765567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.770682] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a in Status: IN_PROGRESS for 2s [ 728.784141] env[70287]: INFO networking_nsxv3.common.synchronization [req-49658a0c-2b51-470f-be2c-aaf02bf1e7aa req-265eaf5a-9ec3-48f4-9635-26451c7a5a4d tempest-FloatingIPsAssociationTestJSON-116958673 tempest-FloatingIPsAssociationTestJSON-116958673-project-member] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 728.784141] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 728.784141] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.786220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.786319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.786617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.786796] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.786899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.786960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.787135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.787216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.787304] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.964295] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.964460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.964530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.964756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.964851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.964950] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c is going to be created. [ 728.987626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.987777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.987844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.988919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.988919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.998968] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: UNINITIALIZED for 2s [ 729.203986] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.206959] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.208949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.208949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.208949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.208949] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.208949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.208949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.208949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.209540] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.210675] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.210675] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 729.210675] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 729.210675] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 729.210891] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 729.211058] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 729.211875] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 729.230784] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 729.231083] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 729.231137] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 729.231319] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-863" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.231676] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-b74c34b9-8969-4dc8-9921-e2a545827aca taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.231870] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.231994] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.232358] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.232513] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74c34b9-8969-4dc8-9921-e2a545827aca',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.290304] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.706208] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c4fea80-b8d6-423e-9f82-93c6ef731d08: rpc.has_security_group_logging(os_id): False [ 729.723969] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.723969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.724232] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.724303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.724441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.724667] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.724790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.724854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.725021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.725102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.725194] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be created. [ 729.740393] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.740522] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.740776] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.740864] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.742236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.742236] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port b74c34b9-8969-4dc8-9921-e2a545827aca not found, creating... [ 729.742236] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.742236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.742236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.742236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.742236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.742897] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.742897] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.742897] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.742897] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.743048] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.743305] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: b74c34b9-8969-4dc8-9921-e2a545827aca is going to be created. [ 729.760186] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.760538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.761077] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.761077] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.761354] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.761602] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.783143] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.783269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.783269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.783482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.783665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.792694] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.806980] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 730.295812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.296175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.296175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.296350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.296502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.296613] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 is going to be updated. [ 730.333586] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.333778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.333846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.334141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.334341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.352470] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: IN_PROGRESS for 2s [ 730.679596] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 730.679917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.781449] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a in Status: SUCCESS [ 730.781554] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a deletion is rescheduled due to dependency. [ 730.782188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.839887] env[70287]: INFO networking_nsxv3.common.synchronization [req-49658a0c-2b51-470f-be2c-aaf02bf1e7aa req-d3ade53d-4ebd-4a39-9c52-9f93f7c4526a service nova] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_rules [ 730.839887] env[70287]: INFO networking_nsxv3.common.synchronization [req-49658a0c-2b51-470f-be2c-aaf02bf1e7aa req-d3ade53d-4ebd-4a39-9c52-9f93f7c4526a service nova] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 730.839887] env[70287]: INFO networking_nsxv3.common.synchronization [req-49658a0c-2b51-470f-be2c-aaf02bf1e7aa req-d3ade53d-4ebd-4a39-9c52-9f93f7c4526a service nova] Enqueued Resource ID: b74c34b9-8969-4dc8-9921-e2a545827aca with Priority: HIGHEST for action port [ 730.839887] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_rules [ 730.839887] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 730.839887] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b74c34b9-8969-4dc8-9921-e2a545827aca with Priority: HIGHEST for action port [ 730.840421] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.840602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.840723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.840974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.841133] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.842968] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.843496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.843650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-b74c34b9-8969-4dc8-9921-e2a545827aca taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.844056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.845419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.845419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.845419] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b74c34b9-8969-4dc8-9921-e2a545827aca',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.012860] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: SUCCESS [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.012860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.012860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.012860] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.348513] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.348513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.351580] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b74c34b9-8969-4dc8-9921-e2a545827aca with status ACTIVE [ 731.351580] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.351580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.351580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.351580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.351580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.351912] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.351912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.351912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.352024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.352156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.352775] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.352775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.352775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.352775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.352775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.352775] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b74c34b9-8969-4dc8-9921-e2a545827aca is going to be updated. [ 731.372966] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.373443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.373443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.373443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.373594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.373930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b74c34b9-8969-4dc8-9921-e2a545827aca" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.434517] env[70287]: INFO networking_nsxv3.common.synchronization [req-205ced2a-865c-47d4-a65e-1817d389d664 req-ce5f5856-3498-49a9-8406-974c3bc5a7f2 tempest-DeleteServersAdminTestJSON-1239410168 tempest-DeleteServersAdminTestJSON-1239410168-project-member] Enqueued Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 731.435156] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 with Priority: HIGHEST for action security_group_members [ 731.435942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.436073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.436073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.436318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.436442] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.436546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.436608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.436757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.436843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.436935] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.515305] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.751363] env[70287]: INFO networking_nsxv3.common.synchronization [req-c0a6aeec-1a6d-4903-9f69-f1e6b301cf8c req-ecd5d4cb-39cc-4b1e-93d7-c1f9df5b8645 tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 731.751984] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 731.752295] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.752425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.752491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.752742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.752897] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.752999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.754604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.754810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.754907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.755024] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.819072] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 731.819591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.941293] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.942097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.942324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.942770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.943187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.943644] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.943940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.944143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.944478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.944663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.944836] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 is going to be updated. [ 731.974021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.974021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.974021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.974021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.974021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.981423] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: IN_PROGRESS for 2s [ 732.021514] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 103dc013-133c-4ce6-897f-dbfb9383e30c: rpc.has_security_group_logging(os_id): False [ 732.036830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.036830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.037063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.037845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.038032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.038729] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.038729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.038729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.039092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.039092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.039092] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c is going to be created. [ 732.098581] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.098757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.098830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.099045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.099840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.112857] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: IN_PROGRESS for 2s [ 732.257526] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.257526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.257526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.257730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.257730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.257960] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.257960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.258087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.258154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.258210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.258373] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 already deleted. [ 732.258373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.364709] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: SUCCESS [ 732.364709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.364709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.364709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.364709] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.364709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.364709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.364709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.364709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.364709] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.480198] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.480373] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.482212] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.482619] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.483094] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.483312] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.483441] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.483678] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.483826] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.484097] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.484216] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.484327] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.484435] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.484547] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 732.484669] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.484809] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.502623] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.502784] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 732.502917] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.503181] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.504853] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-0beb98fc-058f-4c9b-a895-131f291a951c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.504853] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.504853] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.504853] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.504853] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0beb98fc-058f-4c9b-a895-131f291a951c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.865249] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.006712] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.007908] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.008246] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.008647] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.009297] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.009568] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 0beb98fc-058f-4c9b-a895-131f291a951c not found, creating... [ 733.009954] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.012018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.012018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.012018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.012018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.012018] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.012018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.013900] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.014831] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.014831] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.014831] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 0beb98fc-058f-4c9b-a895-131f291a951c is going to be created. [ 733.035287] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.035287] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.035287] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.035287] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.035287] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.035956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.368991] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.872147] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.872504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.873154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.873511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.875683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.875683] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 is going to be updated. [ 733.900279] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.900742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.900742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.901109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.901278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.910728] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: IN_PROGRESS for 2s [ 733.992293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 in Status: SUCCESS [ 733.992293] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40 deletion is rescheduled due to dependency. [ 733.992293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.103111] env[70287]: INFO networking_nsxv3.common.synchronization [req-c0a6aeec-1a6d-4903-9f69-f1e6b301cf8c req-a72d6c82-85dd-4252-bb98-13b31563777f service nova] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_rules [ 734.105370] env[70287]: INFO networking_nsxv3.common.synchronization [req-c0a6aeec-1a6d-4903-9f69-f1e6b301cf8c req-a72d6c82-85dd-4252-bb98-13b31563777f service nova] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 734.106961] env[70287]: INFO networking_nsxv3.common.synchronization [req-c0a6aeec-1a6d-4903-9f69-f1e6b301cf8c req-a72d6c82-85dd-4252-bb98-13b31563777f service nova] Enqueued Resource ID: 0beb98fc-058f-4c9b-a895-131f291a951c with Priority: HIGHEST for action port [ 734.107747] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_rules [ 734.108194] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 734.108409] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0beb98fc-058f-4c9b-a895-131f291a951c with Priority: HIGHEST for action port [ 734.112022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.112022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.112022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.112022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.112022] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.112022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.112022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.112022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.112022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.112022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.112022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.112590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.113224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.113398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.113577] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.116422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-0beb98fc-058f-4c9b-a895-131f291a951c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.116572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.116666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.116885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.116966] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0beb98fc-058f-4c9b-a895-131f291a951c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.132295] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: SUCCESS [ 734.132416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.153774] env[70287]: INFO networking_nsxv3.common.synchronization [req-396b2776-8738-4fdc-abbb-0c6fe47a4cf9 req-0793e4c7-4730-4a26-8fdb-ab1be93e535c tempest-ListImageFiltersTestJSON-688226099 tempest-ListImageFiltersTestJSON-688226099-project-member] Enqueued Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 734.155240] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 with Priority: HIGHEST for action security_group_members [ 734.156918] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7801a11-9fa5-48e7-852a-cce31e8a5030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.157186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.157422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.157694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.157983] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.159021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.159177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.159549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.159696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.159849] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7801a11-9fa5-48e7-852a-cce31e8a5030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.617407] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.625027] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0beb98fc-058f-4c9b-a895-131f291a951c with status ACTIVE [ 734.625027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.625027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.625027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.625027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.625770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.625770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.625770] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0beb98fc-058f-4c9b-a895-131f291a951c is going to be updated. [ 734.627112] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.627299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.655532] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.655715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.655783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.655998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.656198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.656605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0beb98fc-058f-4c9b-a895-131f291a951c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.663267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.663416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.663475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.663690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.663783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.664122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.664122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.664345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.664345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.664419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.664471] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 is going to be updated. [ 734.693538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.693739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.693840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.694156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.694327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.704031] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: IN_PROGRESS for 2s [ 735.119332] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.622139] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.622461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.622461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.622751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.622875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.623010] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 is going to be created. [ 735.646074] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.646074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.646074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.646074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.646074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.653973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: UNINITIALIZED for 2s [ 735.924039] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: SUCCESS [ 735.924039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.924309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.924858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.925314] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.927257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.927257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.927257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.927257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.927257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.927257] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.014175] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d74b0e6e-0d87-4111-b524-3e590d167bd8 tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 34fe01e3-74f2-47f9-b28d-1a1a19d28154 with Priority: HIGHEST for action security_group_rules [ 736.014175] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fe01e3-74f2-47f9-b28d-1a1a19d28154 with Priority: HIGHEST for action security_group_rules [ 736.014175] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.014330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.014330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.014582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.014660] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34fe01e3-74f2-47f9-b28d-1a1a19d28154',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.031161] env[70287]: INFO networking_nsxv3.common.synchronization [req-093ea0b8-3380-46ec-9256-317dd959656c req-49fb170a-e00c-4c11-8737-d093659f8d1c tempest-ServersTestFqdnHostnames-222205351 tempest-ServersTestFqdnHostnames-222205351-project-member] Enqueued Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_members [ 736.031161] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e268cb7c-d939-4cae-9df0-54709ed24656 with Priority: HIGHEST for action security_group_members [ 736.031512] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e268cb7c-d939-4cae-9df0-54709ed24656 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.032105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.032430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.034639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.034639] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.034639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.034639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.034639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.034639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.034639] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e268cb7c-d939-4cae-9df0-54709ed24656',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.313457] env[70287]: INFO networking_nsxv3.common.synchronization [None req-16479048-4446-4068-8f51-5b3049f39bb4 tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 34fe01e3-74f2-47f9-b28d-1a1a19d28154 with Priority: HIGHEST for action security_group_rules [ 736.315082] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34fe01e3-74f2-47f9-b28d-1a1a19d28154 with Priority: HIGHEST for action security_group_rules [ 736.321553] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.321553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.430222] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.430311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.430354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.430611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.430731] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.430832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.430928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.431561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.431561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.431561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.431561] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.431561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.431788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.431788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.431922] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.432093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.432177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.432327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.432419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.432547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.432682] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.537314] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.537495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.540043] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34fe01e3-74f2-47f9-b28d-1a1a19d28154 already deleted. [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.540043] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.540043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.540043] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.541668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.541668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.541668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.541668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.541668] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e268cb7c-d939-4cae-9df0-54709ed24656 is going to be updated. [ 736.543255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.543255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.543255] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34fe01e3-74f2-47f9-b28d-1a1a19d28154',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.567028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.567186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.567297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.567642] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.568035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.582813] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e268cb7c-d939-4cae-9df0-54709ed24656 in Status: IN_PROGRESS for 2s [ 736.713582] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 in Status: SUCCESS [ 736.713843] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7801a11-9fa5-48e7-852a-cce31e8a5030 deletion is rescheduled due to dependency. [ 736.713843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7801a11-9fa5-48e7-852a-cce31e8a5030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.942097] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10ebe6dc-47f0-434b-95e1-44ef22b9a387: rpc.has_security_group_logging(os_id): False [ 736.961142] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.961409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.961409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.961539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.961924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.961924] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.961924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.962330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.962330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.962330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.962440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.962487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.962519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.962780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.962780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.962909] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.962987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.964650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.966025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.966106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.966207] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 is going to be updated. [ 737.023699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.023854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.024034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.024164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.024325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.035087] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: IN_PROGRESS for 2s [ 737.060088] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.060244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.060300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.063297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.063297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.063297] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34fe01e3-74f2-47f9-b28d-1a1a19d28154 already deleted. [ 737.063297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34fe01e3-74f2-47f9-b28d-1a1a19d28154" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.669071] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: SUCCESS [ 737.669320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.669572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.669788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.669986] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.670123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.670193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.670368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.670438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.670535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.670636] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.173615] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.173918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.173918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.174073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.174278] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.174393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.174457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.174618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.174707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.174795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.174980] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.175100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.175163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.175343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.175491] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.177235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.177235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.177235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.177235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.177235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.177235] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.592801] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e268cb7c-d939-4cae-9df0-54709ed24656 in Status: SUCCESS [ 738.593018] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e268cb7c-d939-4cae-9df0-54709ed24656 deletion is rescheduled due to dependency. [ 738.593304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e268cb7c-d939-4cae-9df0-54709ed24656" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.680918] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fe525ed-6fed-4da6-b1de-de2234e26337: rpc.has_security_group_logging(os_id): False [ 738.697913] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.698105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.698188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.698434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.698524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.698717] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.698817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.698877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.699041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.699120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.699310] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.699405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.699467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.699608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.699682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.699865] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.699959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.700030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.700172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.700245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.700333] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 is going to be created. [ 738.753332] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.753332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.753332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.753332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.753332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.765608] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: IN_PROGRESS for 2s [ 739.058287] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: SUCCESS [ 739.058502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.236157] env[70287]: INFO networking_nsxv3.common.synchronization [req-be114d1f-b499-49d8-b68d-92177f6fc787 req-8475d547-6a66-415e-b81c-df44de73a8b7 tempest-VolumesAdminNegativeTest-1117785024 tempest-VolumesAdminNegativeTest-1117785024-project-member] Enqueued Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_members [ 739.236157] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_members [ 739.236157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace6632-4a31-4f49-8463-d0be4cce8713 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.236157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.236157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.236157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.236855] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.237134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.237296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.237610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.237808] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.237982] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.746051] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.746051] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.746051] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace6632-4a31-4f49-8463-d0be4cce8713 already deleted. [ 739.746051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.083036] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-714 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.083316] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.083451] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.083722] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.083985] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.084254] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.084401] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.084654] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.084840] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.085088] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.085231] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.085374] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.085514] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.085687] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 740.085824] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.085990] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.105754] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.105987] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 740.106832] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.107075] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-714" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.107433] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-a703f2f1-cff2-47e8-a868-3206e19a7362 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.112169] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.112169] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.112169] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.112169] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a703f2f1-cff2-47e8-a868-3206e19a7362',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.612939] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.613334] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.613404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.613825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.614027] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.614213] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port a703f2f1-cff2-47e8-a868-3206e19a7362 not found, creating... [ 740.614489] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.614646] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.614764] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.614992] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.615153] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.615476] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.615659] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.615778] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.615988] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.616263] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.616436] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: a703f2f1-cff2-47e8-a868-3206e19a7362 is going to be created. [ 740.635590] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.635851] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.635916] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.636304] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.636595] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.636855] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.775808] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: SUCCESS [ 740.776178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.591024] env[70287]: INFO networking_nsxv3.common.synchronization [req-be114d1f-b499-49d8-b68d-92177f6fc787 req-c2c092e4-0b28-4c83-b65f-5d664c0d3ea0 service nova] Enqueued Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_rules [ 741.591024] env[70287]: INFO networking_nsxv3.common.synchronization [req-be114d1f-b499-49d8-b68d-92177f6fc787 req-c2c092e4-0b28-4c83-b65f-5d664c0d3ea0 service nova] Enqueued Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_members [ 741.591024] env[70287]: INFO networking_nsxv3.common.synchronization [req-be114d1f-b499-49d8-b68d-92177f6fc787 req-c2c092e4-0b28-4c83-b65f-5d664c0d3ea0 service nova] Enqueued Resource ID: a703f2f1-cff2-47e8-a868-3206e19a7362 with Priority: HIGHEST for action port [ 741.591024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_rules [ 741.591024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_members [ 741.591024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a703f2f1-cff2-47e8-a868-3206e19a7362 with Priority: HIGHEST for action port [ 741.591024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aace6632-4a31-4f49-8463-d0be4cce8713 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.591024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.591024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.592706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.592706] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.595257] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace6632-4a31-4f49-8463-d0be4cce8713 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.595380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.595447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.598595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.598595] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.598595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a703f2f1-cff2-47e8-a868-3206e19a7362 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.598595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.598595] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a703f2f1-cff2-47e8-a868-3206e19a7362',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.099419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace6632-4a31-4f49-8463-d0be4cce8713 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.099698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.100090] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.100954] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a703f2f1-cff2-47e8-a868-3206e19a7362 with status ACTIVE [ 742.101247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.101375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.101435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.101645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.102262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.102262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.102262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.102262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.102262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.102262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.102495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.102495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.102565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.102692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.102765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.104041] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a703f2f1-cff2-47e8-a868-3206e19a7362 is going to be updated. [ 742.122071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.122151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.122194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.122366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.122496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.122652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a703f2f1-cff2-47e8-a868-3206e19a7362" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.604901] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.851359] env[70287]: INFO networking_nsxv3.common.synchronization [req-307e4cd8-29ef-4611-8384-c4aa04c23076 req-ed266ecd-9119-44dc-b7ef-0d80911c37d5 tempest-ServersTestManualDisk-1622628182 tempest-ServersTestManualDisk-1622628182-project-member] Enqueued Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_members [ 742.852310] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGHEST for action security_group_members [ 742.852694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.853465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.853465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.853465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.853967] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.853967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.853967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.854253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.854358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.854516] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.108146] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.108464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.108464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.112154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.112301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.112418] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace6632-4a31-4f49-8463-d0be4cce8713 is going to be created. [ 743.134877] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.135030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.135089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.135288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.135440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.146645] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace6632-4a31-4f49-8463-d0be4cce8713 in Status: UNINITIALIZED for 2s [ 743.356431] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.356549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.356612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.356839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.356929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.357137] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.357234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.357295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.357438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.357511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.357594] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 is going to be updated. [ 743.395728] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.395881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.395950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.396179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.396327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.405504] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 in Status: IN_PROGRESS for 2s [ 744.167786] env[70287]: INFO networking_nsxv3.common.synchronization [req-8c09bcaf-74b5-42dd-8129-c15feee06d64 req-ea9fb110-3234-439d-b243-3d67374e928a tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 744.167786] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 744.167786] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.167786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.168819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.169191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.170185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.170336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.170422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.170617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.171012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.171012] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.674035] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.158714] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace6632-4a31-4f49-8463-d0be4cce8713 in Status: SUCCESS [ 745.159040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.162410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.162509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.162714] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.162820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.162884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.163061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.163146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.163270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.163356] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.178435] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.416424] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 in Status: SUCCESS [ 745.416424] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 deletion is rescheduled due to dependency. [ 745.416424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.665329] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace6632-4a31-4f49-8463-d0be4cce8713 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.665501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.665611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.665840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.666026] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.666130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.666195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.666346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.666441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.666549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.666697] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace6632-4a31-4f49-8463-d0be4cce8713 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.666788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.666849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.666993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.667172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.667273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.667338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.667480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.667601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.667720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.667831] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.680954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.681552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.681688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.681958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.682120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.682276] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 is going to be updated. [ 745.709685] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.709685] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.709852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.709949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.710112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.722493] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: IN_PROGRESS for 2s [ 745.756349] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.756349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.756349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.756349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.756349] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.756349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.756349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.756349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.756349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.757194] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.757469] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 745.757714] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 745.759828] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 745.759828] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 745.759828] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 745.759828] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 745.777446] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 745.777446] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 745.777446] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 745.777446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.777446] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.777446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.777446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.777446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.777446] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.170405] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aace6632-4a31-4f49-8463-d0be4cce8713: rpc.has_security_group_logging(os_id): False [ 746.203109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.203109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.203109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.203109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.203782] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.203782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.203782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.203782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.203782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.206719] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aace6632-4a31-4f49-8463-d0be4cce8713 is going to be created. [ 746.274738] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.276729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.276729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.276729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.276729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.283017] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.283017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 not found, creating... [ 746.283017] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.283017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.283496] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.283496] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.283496] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.283496] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.283496] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.283496] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 is going to be created. [ 746.286102] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aace6632-4a31-4f49-8463-d0be4cce8713 in Status: IN_PROGRESS for 2s [ 746.306327] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.306327] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.306327] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.306327] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.306327] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.306327] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.931313] env[70287]: INFO networking_nsxv3.common.synchronization [req-36581d8b-e129-4d83-bd71-f417da61fe91 req-210831e5-e2a2-4239-acae-21199b2f03e7 tempest-FloatingIPsAssociationTestJSON-116958673 tempest-FloatingIPsAssociationTestJSON-116958673-project-member] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 746.931313] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 746.932667] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.932667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.932667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.933154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.933880] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.934058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.934171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.935506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.935723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.935949] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.209540] env[70287]: INFO networking_nsxv3.common.synchronization [req-8c09bcaf-74b5-42dd-8129-c15feee06d64 req-e4a28b52-ea1b-40c1-adbb-2b7e1be2e9f9 service nova] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_rules [ 747.209768] env[70287]: INFO networking_nsxv3.common.synchronization [req-8c09bcaf-74b5-42dd-8129-c15feee06d64 req-e4a28b52-ea1b-40c1-adbb-2b7e1be2e9f9 service nova] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 747.209768] env[70287]: INFO networking_nsxv3.common.synchronization [req-8c09bcaf-74b5-42dd-8129-c15feee06d64 req-e4a28b52-ea1b-40c1-adbb-2b7e1be2e9f9 service nova] Enqueued Resource ID: 71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 with Priority: HIGHEST for action port [ 747.209962] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_rules [ 747.210675] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 747.210675] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 with Priority: HIGHEST for action port [ 747.210815] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.210815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.210933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.211625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.211625] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.212158] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.212225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.212397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.212497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.212558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.212725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.212806] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.443581] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.715025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.715025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.715025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 with status ACTIVE [ 747.715255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.715326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.715633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.715633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.715747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.715844] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.715939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.716014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.716161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.716230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.716402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.716482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.716542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.716676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.716744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.716821] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6 is going to be updated. [ 747.730781] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: SUCCESS [ 747.730999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.731398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.731466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.731615] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.731721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.732055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.732055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.732055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.732174] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.738846] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.738846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.738846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.738846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.738846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.738846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71a90361-a7f3-4f77-b5b5-a3e1fe68b6f6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.945400] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.234429] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.300763] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aace6632-4a31-4f49-8463-d0be4cce8713 in Status: SUCCESS [ 748.300763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.450540] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.450540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.450540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.450540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.450540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.450540] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 is going to be updated. [ 748.477122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.477122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.477122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.477122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.477122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.487343] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: IN_PROGRESS for 2s [ 748.736945] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.241984] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.241984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.241984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.241984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.242592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.242592] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 is going to be updated. [ 749.277360] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.277606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.277606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.278192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.278192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.287756] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: IN_PROGRESS for 2s [ 750.499384] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: SUCCESS [ 750.499384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.299054] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: SUCCESS [ 751.299119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.299557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.299557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.299662] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.302534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.302534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.302534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.302534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.302534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.302534] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.612539] env[70287]: INFO networking_nsxv3.common.synchronization [None req-258e77ef-2f8d-4681-82aa-58bb277a311c None None] Enqueued Resource ID: 8053eb0f-5742-4f5a-9bc4-479433916e79 with Priority: HIGHEST for action port [ 751.612805] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8053eb0f-5742-4f5a-9bc4-479433916e79 with Priority: HIGHEST for action port [ 751.613418] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-8053eb0f-5742-4f5a-9bc4-479433916e79 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.613581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8053eb0f-5742-4f5a-9bc4-479433916e79" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.613617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8053eb0f-5742-4f5a-9bc4-479433916e79" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.613841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8053eb0f-5742-4f5a-9bc4-479433916e79" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.613925] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8053eb0f-5742-4f5a-9bc4-479433916e79',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.804812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.804812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.804812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.804812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.804812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.804812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.804812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.805080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.805080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.805144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.805234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.805338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.805418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.805569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.805775] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.805923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.806029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.806149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.806225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.806306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.806725] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.117075] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8053eb0f-5742-4f5a-9bc4-479433916e79 [ 752.117370] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.117540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.117631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.121018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.121018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.121018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8053eb0f-5742-4f5a-9bc4-479433916e79 already deleted. [ 752.121018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8053eb0f-5742-4f5a-9bc4-479433916e79" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.309420] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3fe525ed-6fed-4da6-b1de-de2234e26337: rpc.has_security_group_logging(os_id): False [ 752.326805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.326955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.327077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.327710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.327888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.328135] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.328310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.328383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.328756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.328850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.329196] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.329328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.329407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.329588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.329685] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.329895] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.331082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.332023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.332023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.332023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.332023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 is going to be updated. [ 752.387340] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.387613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.387719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.387900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.388204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.399234] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: IN_PROGRESS for 2s [ 752.758403] env[70287]: INFO networking_nsxv3.common.synchronization [None req-c0b5c564-a9c8-455b-a6cf-421477ad6449 tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 752.759086] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 752.759231] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.759375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.759442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.759684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.759781] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.878167] env[70287]: INFO networking_nsxv3.common.synchronization [None req-e497a20d-4d16-44bd-9d80-0a51fd84b8a1 tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 752.878498] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 752.879583] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.879583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.281109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.281361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.281434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.281673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.281759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.281853] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 already deleted. [ 753.281936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.282132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.282482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.282482] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.596796] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent loop - iteration:0 completed [ 753.597507] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent loop - iteration:1 started [ 753.803564] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.804212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.804212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.804212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.804212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.804212] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 already deleted. [ 753.804483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.865805] env[70287]: INFO networking_nsxv3.common.synchronization [None req-29cb89f0-b406-482a-9b9b-7dbf139de8f4 None None] Enqueued Resource ID: d9439bd8-7154-4513-af0d-74b93b2e313b with Priority: HIGHEST for action port [ 753.865805] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9439bd8-7154-4513-af0d-74b93b2e313b with Priority: HIGHEST for action port [ 753.865805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9439bd8-7154-4513-af0d-74b93b2e313b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.865805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9439bd8-7154-4513-af0d-74b93b2e313b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.865805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9439bd8-7154-4513-af0d-74b93b2e313b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.866222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9439bd8-7154-4513-af0d-74b93b2e313b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.866411] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9439bd8-7154-4513-af0d-74b93b2e313b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.371017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9439bd8-7154-4513-af0d-74b93b2e313b [ 754.371261] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.371417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.371494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.371702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.371793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.371889] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9439bd8-7154-4513-af0d-74b93b2e313b already deleted. [ 754.371969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9439bd8-7154-4513-af0d-74b93b2e313b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.412201] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: SUCCESS [ 754.412404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.648090] env[70287]: INFO networking_nsxv3.common.synchronization [req-07129d22-b29c-465d-b325-f6f808d0ffb2 req-a768882b-35ac-47ad-883c-6579a397b324 tempest-VolumesAdminNegativeTest-1117785024 tempest-VolumesAdminNegativeTest-1117785024-project-member] Enqueued Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_members [ 756.648618] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aace6632-4a31-4f49-8463-d0be4cce8713 with Priority: HIGHEST for action security_group_members [ 756.648915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aace6632-4a31-4f49-8463-d0be4cce8713 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.649052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.649117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.649310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.649462] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.649558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.649615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.649760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.649939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.650055] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aace6632-4a31-4f49-8463-d0be4cce8713',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.152536] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.152707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.152844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.153103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.153227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.153482] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.153588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.153700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.153883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.153966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.154072] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace6632-4a31-4f49-8463-d0be4cce8713 is going to be updated. [ 757.182157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.182293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.182361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.182553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.182689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.190853] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace6632-4a31-4f49-8463-d0be4cce8713 in Status: IN_PROGRESS for 2s [ 759.202964] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aace6632-4a31-4f49-8463-d0be4cce8713 in Status: SUCCESS [ 759.203437] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aace6632-4a31-4f49-8463-d0be4cce8713 deletion is rescheduled due to dependency. [ 759.203533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aace6632-4a31-4f49-8463-d0be4cce8713" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.571991] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7114298-2114-4ecc-9d0c-2613b28ef304 req-a3948c18-e76b-4b77-8ea8-9ea2b5fd1e5b tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 759.572545] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 759.572841] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.572966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.573044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.573246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.573444] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.573722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.573722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.573904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.574066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.574174] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.874736] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.874942] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.875083] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.875351] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.875609] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.875767] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.875895] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.876293] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.876455] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.876670] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.876791] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 759.876895] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 759.877010] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 759.877158] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 759.877270] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 759.877417] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 759.895623] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 759.895872] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 759.895971] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 759.896445] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.896445] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-ff54d183-c6f6-4bff-973e-437424d3f217 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.896862] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.896862] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.897036] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.897205] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff54d183-c6f6-4bff-973e-437424d3f217',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.077202] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.077391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.077478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.077714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.078316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.078316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.078316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.078316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.078513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.078513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.078513] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 760.102367] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.102530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.102530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.102671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.102846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.122359] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 760.400296] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.400711] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.400751] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.401461] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.401461] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.401461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port ff54d183-c6f6-4bff-973e-437424d3f217 not found, creating... [ 760.401712] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.401916] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.402082] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.402285] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.402423] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.402785] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.402982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.403153] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.403386] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.403549] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.403700] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: ff54d183-c6f6-4bff-973e-437424d3f217 is going to be created. [ 760.423293] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.423543] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.423679] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.423954] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.424201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.424450] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.119393] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7114298-2114-4ecc-9d0c-2613b28ef304 req-89ed1b5b-702e-46e9-a2e0-0b122d79b9b7 service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 761.119559] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7114298-2114-4ecc-9d0c-2613b28ef304 req-89ed1b5b-702e-46e9-a2e0-0b122d79b9b7 service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 761.119701] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7114298-2114-4ecc-9d0c-2613b28ef304 req-89ed1b5b-702e-46e9-a2e0-0b122d79b9b7 service nova] Enqueued Resource ID: ff54d183-c6f6-4bff-973e-437424d3f217 with Priority: HIGHEST for action port [ 761.119960] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 761.120131] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 761.120208] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff54d183-c6f6-4bff-973e-437424d3f217 with Priority: HIGHEST for action port [ 761.120771] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.123525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.123525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.123525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.123525] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.124152] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.124152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.124356] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff54d183-c6f6-4bff-973e-437424d3f217 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.124457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.124518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.124699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.124784] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff54d183-c6f6-4bff-973e-437424d3f217',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.627996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.627996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.632869] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff54d183-c6f6-4bff-973e-437424d3f217 with status ACTIVE [ 761.632869] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.632869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.632869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.633293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.633293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.633450] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.633542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.633596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.633771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.633856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.634936] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.634936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.634936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.634936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.634936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.634936] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff54d183-c6f6-4bff-973e-437424d3f217 is going to be updated. [ 761.653360] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.654140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.654140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.654140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.654380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.654654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff54d183-c6f6-4bff-973e-437424d3f217" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.113250] env[70287]: INFO networking_nsxv3.common.synchronization [req-2e351aa8-9703-40c6-871a-d64a0fc457ca req-a2eaa2f6-97de-4e1d-b6d5-c22ed7b5be68 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 762.113836] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 762.114141] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.114343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.114343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.114514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.114668] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.114766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.114832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.114980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.115077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.115172] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.131169] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 4s [ 762.562840] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-29 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.563050] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.563180] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.563521] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.563738] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.563904] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.567901] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.568260] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.568426] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.568668] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.568776] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.568874] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.568984] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.569116] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 762.569273] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.569434] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.586581] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.586747] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 762.586899] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.587147] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-29" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.587462] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-31d79382-e9e1-488f-8c70-ce60b87e2378 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.587638] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.587762] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.588076] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.588216] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d79382-e9e1-488f-8c70-ce60b87e2378',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.617558] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.091902] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.091902] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.091902] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.092323] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.092323] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.092323] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 31d79382-e9e1-488f-8c70-ce60b87e2378 not found, creating... [ 763.092479] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.092635] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.092748] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.092969] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.093111] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.093381] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.093560] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.095565] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.095565] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.095565] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.095565] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 is going to be created. [ 763.113050] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.113050] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.113050] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.113050] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.113289] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.113327] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.118903] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.621229] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.621384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.621458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.621671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.621764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.621865] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 763.650405] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.650544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.650620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.650868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.651016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.660890] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 764.083115] env[70287]: INFO networking_nsxv3.common.synchronization [req-2e351aa8-9703-40c6-871a-d64a0fc457ca req-12815594-e7d2-4b1f-99aa-b5083f9fd8c7 service nova] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 764.083115] env[70287]: INFO networking_nsxv3.common.synchronization [req-2e351aa8-9703-40c6-871a-d64a0fc457ca req-12815594-e7d2-4b1f-99aa-b5083f9fd8c7 service nova] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 764.083115] env[70287]: INFO networking_nsxv3.common.synchronization [req-2e351aa8-9703-40c6-871a-d64a0fc457ca req-12815594-e7d2-4b1f-99aa-b5083f9fd8c7 service nova] Enqueued Resource ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 with Priority: HIGHEST for action port [ 764.083115] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 764.083115] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 764.083115] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 with Priority: HIGHEST for action port [ 764.083613] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.084116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.084269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.084554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.084730] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.085770] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.086014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.086457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d79382-e9e1-488f-8c70-ce60b87e2378 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.086856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.087289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.088139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.088139] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d79382-e9e1-488f-8c70-ce60b87e2378',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.143135] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 764.143135] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 764.143426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.143669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.143924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.144080] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.144199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.144263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.144415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.144496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.144616] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.590415] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31d79382-e9e1-488f-8c70-ce60b87e2378 with status ACTIVE [ 764.590754] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.590874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.590960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.591222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.591328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.591530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.591675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.591741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.591949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.592122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.592437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.592503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.592585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.592738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.592834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.592949] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 is going to be updated. [ 764.594193] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.594297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.617990] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.617990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.617990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.617990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.617990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.617990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.649826] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.151904] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.656321] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.656529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.656529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.656746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.656917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.656917] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 765.670841] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 765.671067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.671225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.671434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.671640] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.671757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.671823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.671984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.672116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.672174] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.686679] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.686820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.686938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.687105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.687223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.694614] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 766.176703] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.682707] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.185633] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.186053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.186053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.186123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.186277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.186333] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 767.216032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.216188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.216277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.216458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.216667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.225475] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 767.260858] env[70287]: INFO networking_nsxv3.common.synchronization [req-81e1396f-d51b-401e-9885-8790dca05026 req-139426b1-e8c7-40c4-876f-1c3c45feeec2 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_members [ 767.261553] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_members [ 767.261945] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.262084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.262613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.262872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.263415] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.263625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.263703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.263892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.263985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.264102] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.624651] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.624766] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.624827] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.625098] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.625359] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.625502] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.625761] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.625851] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.627569] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.627569] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.627569] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 767.627569] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 767.627569] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 767.627569] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 767.627569] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 767.627569] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 767.659242] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 767.659425] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 767.659575] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 767.659765] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.660179] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f4363f07-130d-47e7-954a-e010ac5471e3 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.660368] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.660497] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.660889] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.661063] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4363f07-130d-47e7-954a-e010ac5471e3',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.705047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 767.705047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.705047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.705047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.705267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.705328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.705367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.705521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.705602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.705686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.705774] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.766213] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.766377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.766505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.766768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.766882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.767095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.767219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.767278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.767451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.767539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.767628] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea already deleted. [ 767.767713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.164947] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.165319] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.165484] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.165751] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.166214] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.166392] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f4363f07-130d-47e7-954a-e010ac5471e3 not found, creating... [ 768.166651] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.166810] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.166925] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.167165] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.167304] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.167579] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.167732] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.167847] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.168064] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.168198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.168334] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f4363f07-130d-47e7-954a-e010ac5471e3 is going to be created. [ 768.191655] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.191855] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.191981] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.192226] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.192437] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.192656] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.208234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.208404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.208494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.208701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.208916] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.209055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.209146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.209327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.209425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.209544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.209739] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.209865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.209927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.210099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.210285] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.210412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.210476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.210619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.210696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.210775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.210861] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.713377] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e5e0f30-956b-4713-b190-79d66c86985e: rpc.has_security_group_logging(os_id): False [ 768.730603] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.730743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.730811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.731042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.731129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.731345] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.731438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.731552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.731671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.731734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.731889] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.731975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.732042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.732187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.732243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.732414] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.732499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.732577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.732682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.732749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.733235] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 768.790312] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.790312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.790562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.791717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.792906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.804901] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 769.058377] env[70287]: INFO networking_nsxv3.common.synchronization [req-81e1396f-d51b-401e-9885-8790dca05026 req-bdb1da44-bc0e-4ec4-a8eb-fce13cbfa313 service nova] Enqueued Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_rules [ 769.058646] env[70287]: INFO networking_nsxv3.common.synchronization [req-81e1396f-d51b-401e-9885-8790dca05026 req-bdb1da44-bc0e-4ec4-a8eb-fce13cbfa313 service nova] Enqueued Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_members [ 769.060128] env[70287]: INFO networking_nsxv3.common.synchronization [req-81e1396f-d51b-401e-9885-8790dca05026 req-bdb1da44-bc0e-4ec4-a8eb-fce13cbfa313 service nova] Enqueued Resource ID: f4363f07-130d-47e7-954a-e010ac5471e3 with Priority: HIGHEST for action port [ 769.060128] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_rules [ 769.060128] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_members [ 769.060128] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4363f07-130d-47e7-954a-e010ac5471e3 with Priority: HIGHEST for action port [ 769.060128] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.060128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.060128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.060510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.060510] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.061247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.061331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.061377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.062175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.062175] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.062175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.062175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.062175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.062175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.062388] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.063229] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4363f07-130d-47e7-954a-e010ac5471e3 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.063331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.063395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.063612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.063689] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4363f07-130d-47e7-954a-e010ac5471e3',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.234896] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 769.235196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.235327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.235528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.235722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.235973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.235973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.236135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.236135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.236212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.236297] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.565420] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.565623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.565799] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.568888] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f4363f07-130d-47e7-954a-e010ac5471e3 with status ACTIVE [ 769.568888] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.568888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.568888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.568888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.568888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.568888] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.568888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.568888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.569564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.569564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.569564] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.569564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.569564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.569564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.569564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.569820] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f4363f07-130d-47e7-954a-e010ac5471e3 is going to be updated. [ 769.589942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.589942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.589942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.589942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.589942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.589942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4363f07-130d-47e7-954a-e010ac5471e3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.739039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.739039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.739228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.739292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.739469] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.739581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.739649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.739808] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.739900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.740067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.740219] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.740308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.740364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.740505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.740639] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.740731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.740801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.740962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.741047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.741127] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.741215] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.068541] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.245359] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e57bed-6bad-4f87-86dc-05486c964c31: rpc.has_security_group_logging(os_id): False [ 770.263960] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.263960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.263960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.263960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.263960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.264240] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.264240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.264329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.264883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.264883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.264883] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.264883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.265687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.265687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.265687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.265687] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.265687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.265687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.265962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.265962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.266052] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 770.319149] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.319301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.319371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.319585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.319757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.331877] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 770.570820] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.571075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.571175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.571362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.571605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.571750] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea is going to be created. [ 770.593484] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.593666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.593747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.594418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.594418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.606563] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea in Status: UNINITIALIZED for 2s [ 770.817957] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 770.818361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.346330] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 772.346614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.617091] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea in Status: SUCCESS [ 772.617224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.617386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.617592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.617781] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.617907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.617952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.621075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.621075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.621075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.621075] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.121349] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.624235] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7e1295d-86bf-45fa-b2c1-808d7d01f3ea: rpc.has_security_group_logging(os_id): False [ 773.644093] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.644245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.644327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.644583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.644706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.644970] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.645115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.645184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.645409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.645487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.645607] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea is going to be created. [ 773.703620] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.703883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.704030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.704358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.704661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.716772] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea in Status: IN_PROGRESS for 2s [ 773.924239] env[70287]: INFO networking_nsxv3.common.synchronization [req-f7b8dce0-4f1f-4390-a228-feea9dcaa81a req-509148c7-68cc-4d49-84f7-80a170840cc5 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 773.924239] env[70287]: INFO networking_nsxv3.common.synchronization [req-f7b8dce0-4f1f-4390-a228-feea9dcaa81a req-509148c7-68cc-4d49-84f7-80a170840cc5 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 773.924239] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 773.924239] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 773.924239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.924239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.924239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.924239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.924239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.924239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.924239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.924239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.924239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.924239] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.925619] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.925752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.925852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.926171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.926916] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.926916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.926916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.926916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.926916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.926916] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.091918] env[70287]: INFO networking_nsxv3.common.synchronization [req-f7b8dce0-4f1f-4390-a228-feea9dcaa81a req-509148c7-68cc-4d49-84f7-80a170840cc5 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 774.093024] env[70287]: INFO networking_nsxv3.common.synchronization [req-f7b8dce0-4f1f-4390-a228-feea9dcaa81a req-509148c7-68cc-4d49-84f7-80a170840cc5 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 774.093024] env[70287]: INFO networking_nsxv3.common.synchronization [req-f7b8dce0-4f1f-4390-a228-feea9dcaa81a req-509148c7-68cc-4d49-84f7-80a170840cc5 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_rules [ 774.093024] env[70287]: INFO networking_nsxv3.common.synchronization [req-f7b8dce0-4f1f-4390-a228-feea9dcaa81a req-509148c7-68cc-4d49-84f7-80a170840cc5 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 774.093024] env[70287]: INFO networking_nsxv3.common.synchronization [req-f7b8dce0-4f1f-4390-a228-feea9dcaa81a req-509148c7-68cc-4d49-84f7-80a170840cc5 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 with Priority: HIGHEST for action port [ 774.096233] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 774.096233] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_rules [ 774.096233] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 with Priority: HIGHEST for action port [ 774.096233] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 774.096233] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 774.097402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.097556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.097630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.097835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.097917] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.098790] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.098861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.101757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.101757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.101757] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.101757] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d79382-e9e1-488f-8c70-ce60b87e2378 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.101757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.101757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.101757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.102413] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d79382-e9e1-488f-8c70-ce60b87e2378',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.104564] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.104660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.104836] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.104913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.357833] env[70287]: INFO networking_nsxv3.common.synchronization [req-1174f532-8c64-425f-a817-ae0c2b233c7c req-363d5414-a17c-42ee-b150-226e005e2a29 tempest-ServerActionsV293TestJSON-1180885877 tempest-ServerActionsV293TestJSON-1180885877-project-member] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_members [ 774.358377] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_members [ 774.359116] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.359116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.359116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.359116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.360598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.360598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.360598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.364311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.364424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.364525] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.427441] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.431042] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.607107] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.607573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.607780] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31d79382-e9e1-488f-8c70-ce60b87e2378 with status ACTIVE [ 774.607994] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.608129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.608196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.608473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.608546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.608682] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.608779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.608836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.609191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.610478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.610690] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.610797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.610863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.611024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.611102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.611189] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 is going to be updated. [ 774.615655] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.615764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.634533] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.634950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.634950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.634950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.635089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.635255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.869584] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.870069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.870544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.870850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.870982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.871315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.871486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.871616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.871855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.871994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.872562] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc already deleted. [ 774.872562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.931472] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.935350] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.436539] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.436905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.437110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.437419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.437609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.438037] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 775.441651] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.443142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.443360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.443727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.444021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.444212] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 is going to be created. [ 775.469804] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-947 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.469804] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-947" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.469804] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-947" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.469804] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-947" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.470457] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.470812] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.470892] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.471198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.471389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.471674] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.471886] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.472057] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.472185] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.472331] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 775.472460] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.472631] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.476278] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.476437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.476564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.476802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.476997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.498712] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.498861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.498935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.499176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.499311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.512764] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: UNINITIALIZED for 2s [ 775.517134] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 775.522903] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.522903] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.048 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 775.522903] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.522903] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-947" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.522903] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-2c8d681c-0565-446f-b113-2ae7380ef119 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.522903] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.522903] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.522903] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.522903] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c8d681c-0565-446f-b113-2ae7380ef119',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.732658] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea in Status: SUCCESS [ 775.732658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.026442] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.026442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.026442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.029020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.029020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.029020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 2c8d681c-0565-446f-b113-2ae7380ef119 not found, creating... [ 776.029020] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.029020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.029020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.029020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.029020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.029020] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.029020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.029678] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.029678] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.029678] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.029678] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 2c8d681c-0565-446f-b113-2ae7380ef119 is going to be created. [ 776.046615] env[70287]: INFO networking_nsxv3.common.synchronization [None req-47e7aa13-2fb7-4c6f-90ff-66d6c84fa13e None None] Enqueued Resource ID: 3cf528ea-be76-44b3-a3e2-0df1a7891db3 with Priority: HIGHEST for action port [ 776.046615] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf528ea-be76-44b3-a3e2-0df1a7891db3 with Priority: HIGHEST for action port [ 776.047036] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf528ea-be76-44b3-a3e2-0df1a7891db3 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.047174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf528ea-be76-44b3-a3e2-0df1a7891db3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.047241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf528ea-be76-44b3-a3e2-0df1a7891db3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.047666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf528ea-be76-44b3-a3e2-0df1a7891db3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.047799] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf528ea-be76-44b3-a3e2-0df1a7891db3',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.061638] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.062627] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.062772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.063108] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.064917] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.064917] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.550361] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3cf528ea-be76-44b3-a3e2-0df1a7891db3 [ 776.552305] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.552305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.552305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.552305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.552305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.552305] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3cf528ea-be76-44b3-a3e2-0df1a7891db3 already deleted. [ 776.552305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf528ea-be76-44b3-a3e2-0df1a7891db3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.915929] env[70287]: INFO networking_nsxv3.common.synchronization [req-2d5f65d1-dd50-4039-b041-cb97ebcc460e req-b6bdc17c-4977-4319-aae9-b870416cb455 tempest-MigrationsAdminTest-1148431189 tempest-MigrationsAdminTest-1148431189-project-member] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 776.915929] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 776.915929] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.915929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.915929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.915929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.915929] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.915929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.915929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.915929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.915929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.915929] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.117976] env[70287]: INFO networking_nsxv3.common.synchronization [req-1174f532-8c64-425f-a817-ae0c2b233c7c req-5a073ba4-732e-45cc-8776-0aaa3191b8e9 service nova] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_rules [ 777.118174] env[70287]: INFO networking_nsxv3.common.synchronization [req-1174f532-8c64-425f-a817-ae0c2b233c7c req-5a073ba4-732e-45cc-8776-0aaa3191b8e9 service nova] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_members [ 777.118312] env[70287]: INFO networking_nsxv3.common.synchronization [req-1174f532-8c64-425f-a817-ae0c2b233c7c req-5a073ba4-732e-45cc-8776-0aaa3191b8e9 service nova] Enqueued Resource ID: 2c8d681c-0565-446f-b113-2ae7380ef119 with Priority: HIGHEST for action port [ 777.118588] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_rules [ 777.118769] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_members [ 777.120605] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c8d681c-0565-446f-b113-2ae7380ef119 with Priority: HIGHEST for action port [ 777.121231] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.121693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.122272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.122650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.123426] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.124298] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.124451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.124603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.124822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.125013] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.125168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.127850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.128058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.128297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.128297] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.131181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c8d681c-0565-446f-b113-2ae7380ef119 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.131336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.131412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.131736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.131895] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c8d681c-0565-446f-b113-2ae7380ef119',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.419231] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.441018] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.441261] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.441962] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.441962] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.441962] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.442220] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.442396] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.442539] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.442711] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.443024] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.443117] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.443174] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.443255] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.443365] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 777.443469] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.443631] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.461880] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.461984] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 777.462159] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.462504] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.462817] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-14e2006c-267b-458c-9fa0-90480148ffe1 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.462912] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.462977] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.463277] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.463409] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e2006c-267b-458c-9fa0-90480148ffe1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.522733] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: SUCCESS [ 777.522856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.523276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.523532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.523764] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.523895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.523983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.524168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.524380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.524380] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.526163] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 777.526338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.526917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.527122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.527264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.527373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.527527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.527691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.527775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.527864] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.634038] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.635094] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.635191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.635354] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c8d681c-0565-446f-b113-2ae7380ef119 with status ACTIVE [ 777.635514] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.635618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.635683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.635886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.636069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.636246] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.636342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.636406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.636560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.636638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.636838] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.636932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.636992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.637181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.637256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.637337] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c8d681c-0565-446f-b113-2ae7380ef119 is going to be updated. [ 777.660768] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.660768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.660768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.661077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.661286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.661539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c8d681c-0565-446f-b113-2ae7380ef119" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.919930] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.968261] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.969739] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.969739] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.969739] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.969739] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.969739] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 14e2006c-267b-458c-9fa0-90480148ffe1 not found, creating... [ 777.969739] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.969739] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.969739] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.970118] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.970118] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.970636] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.970636] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.970636] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.971367] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.971516] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.971714] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 14e2006c-267b-458c-9fa0-90480148ffe1 is going to be created. [ 777.990219] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.990428] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.990551] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.990847] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.991257] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.991333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.019171] env[70287]: INFO networking_nsxv3.common.synchronization [None req-3abd510d-66e3-42cd-a297-2f0fed20d5bb None None] Enqueued Resource ID: e729d056-c925-4268-af44-d2f618225b41 with Priority: HIGHEST for action port [ 778.019171] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e729d056-c925-4268-af44-d2f618225b41 with Priority: HIGHEST for action port [ 778.019552] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e729d056-c925-4268-af44-d2f618225b41 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.020683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e729d056-c925-4268-af44-d2f618225b41" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.020683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e729d056-c925-4268-af44-d2f618225b41" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.020683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e729d056-c925-4268-af44-d2f618225b41" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.020683] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e729d056-c925-4268-af44-d2f618225b41',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.029614] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.030455] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.139542] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.424122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.424325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.424400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.424604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.424701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.424812] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be updated. [ 778.451024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.451176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.451251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.451469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.451654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.461190] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: IN_PROGRESS for 2s [ 778.526649] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e729d056-c925-4268-af44-d2f618225b41 [ 778.526649] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.526649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.526649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.526649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.526649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.526649] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e729d056-c925-4268-af44-d2f618225b41 already deleted. [ 778.526649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e729d056-c925-4268-af44-d2f618225b41" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.534976] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.534976] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.642886] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.642886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.642886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.642886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.642886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.643269] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc is going to be created. [ 778.665048] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.665269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.665269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.665467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.665630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.677040] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: UNINITIALIZED for 2s [ 778.789529] env[70287]: INFO networking_nsxv3.common.synchronization [req-2d5f65d1-dd50-4039-b041-cb97ebcc460e req-29d708af-2362-4677-8a96-aa3d6c92f17a service nova] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_rules [ 778.789529] env[70287]: INFO networking_nsxv3.common.synchronization [req-2d5f65d1-dd50-4039-b041-cb97ebcc460e req-29d708af-2362-4677-8a96-aa3d6c92f17a service nova] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 778.789529] env[70287]: INFO networking_nsxv3.common.synchronization [req-2d5f65d1-dd50-4039-b041-cb97ebcc460e req-29d708af-2362-4677-8a96-aa3d6c92f17a service nova] Enqueued Resource ID: 14e2006c-267b-458c-9fa0-90480148ffe1 with Priority: HIGHEST for action port [ 778.789529] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_rules [ 778.789529] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 778.789529] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e2006c-267b-458c-9fa0-90480148ffe1 with Priority: HIGHEST for action port [ 778.789529] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.789529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.789529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.789529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.791434] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.791434] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.791434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.791434] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e2006c-267b-458c-9fa0-90480148ffe1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.791434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.791434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.791434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.791434] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e2006c-267b-458c-9fa0-90480148ffe1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.037784] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.038107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.038107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.038288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.038338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.038421] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 779.039798] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.039924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.040055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.040196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.040276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.040444] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 is going to be updated. [ 779.066899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.066899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.067142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.067213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.067795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.069273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.069396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.069440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.069609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.069890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.079361] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 779.081238] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: IN_PROGRESS for 2s [ 779.293470] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.293470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.294722] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e2006c-267b-458c-9fa0-90480148ffe1 with status ACTIVE [ 779.294998] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.294998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.295250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.295299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.295362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.295823] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.295823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.295823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.295823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.296080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.296080] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.296200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.296200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.296322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.296373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.296523] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e2006c-267b-458c-9fa0-90480148ffe1 is going to be updated. [ 779.318409] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.318561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.318651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.318890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.319155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.319364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e2006c-267b-458c-9fa0-90480148ffe1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.472763] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: SUCCESS [ 780.473052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.473139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.473330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.473517] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.473704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.473795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.473944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.474035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.474128] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.691192] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: SUCCESS [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.691192] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.691192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.691650] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.979410] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.091987] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: SUCCESS [ 781.092353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.092479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.092770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.093026] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.093167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.093241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.093369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.093444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.093529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.093669] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.095384] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 781.095559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.095703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.095944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.096178] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.096285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.096354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.098467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.098608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.098747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.098852] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.197741] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.270975] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 781.271203] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 781.274412] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_members [ 781.275190] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 781.275333] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 781.275455] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_members [ 781.275804] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.276837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.276837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.276837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.276837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.276837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.276837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.277193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.277193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.277193] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.279611] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.279860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.279940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.280246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.280495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.280615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.280701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.280886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.280976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.281289] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.282313] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-72b6db75-4b87-4e7a-a83d-588864639612 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.282676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.282925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.283058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.283269] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.283420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.283491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.283713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.283807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.284078] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.374360] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 781.374620] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 781.374842] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_rules [ 781.375099] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_members [ 781.375308] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_rules [ 781.375536] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 781.375741] env[70287]: INFO networking_nsxv3.common.synchronization [req-c2438ef2-3356-45e6-9d45-45f591b7021e req-6b8a6a3e-2aa3-48e2-b7bc-b782596905fc tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 with Priority: HIGHEST for action port [ 781.376696] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_rules [ 781.376758] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_rules [ 781.376976] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 781.377092] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 with Priority: HIGHEST for action port [ 781.377257] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_rules [ 781.377388] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 781.377492] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_members [ 781.377808] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.377952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.378198] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-72b6db75-4b87-4e7a-a83d-588864639612 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.378357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.378460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.378763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.378852] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.379860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.379958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.380164] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d79382-e9e1-488f-8c70-ce60b87e2378 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.380282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.380512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.380578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.380659] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d79382-e9e1-488f-8c70-ce60b87e2378',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.381861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.381979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.382168] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.382248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.382525] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-72b6db75-4b87-4e7a-a83d-588864639612 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.382525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.485403] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.601469] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.609214] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.609214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.631712] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7430cb9-69a2-4026-a05a-5cc66d40bf27 req-fe77a7ca-024d-4ed7-a81f-2f8b9f4cbd4b tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 781.632211] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 781.632571] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.633016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.633016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.633488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.633828] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.634008] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.634130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.634338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.634467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.634600] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.701214] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dd050a9-748f-4acb-8e46-7e66c72189cc: rpc.has_security_group_logging(os_id): False [ 781.721590] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.721682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.721798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.722394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.722394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.722394] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.722607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.722607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.722704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.724428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.724428] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc is going to be created. [ 781.782359] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.782514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.782587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.782817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.783663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.789158] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.789587] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.790281] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.803369] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: IN_PROGRESS for 2s [ 781.884552] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31d79382-e9e1-488f-8c70-ce60b87e2378 with status ACTIVE [ 781.884552] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.884725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.884856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.885320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.885320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.885596] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.885692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.885757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.885968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.889024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.889024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.889024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.889024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.889024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.889024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.889024] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31d79382-e9e1-488f-8c70-ce60b87e2378 is going to be updated. [ 781.889024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-72b6db75-4b87-4e7a-a83d-588864639612 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.889024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.924230] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.924230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.924230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.924370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.924468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.924625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d79382-e9e1-488f-8c70-ce60b87e2378" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.989125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.989125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.989125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.989125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.989125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.989546] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be updated. [ 782.026750] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.027451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.027451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.027451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.027451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.037949] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: IN_PROGRESS for 2s [ 782.103442] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6ce8eb0-1f95-4fbe-ad32-829aa60405a9: rpc.has_security_group_logging(os_id): False [ 782.124176] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.124334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.124404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.124624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.124736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.124968] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.125085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.125234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.125296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.125389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.125476] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 is going to be created. [ 782.137690] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.137931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.137931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.138211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.138317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.138530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.138632] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.138716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.138873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.138997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.138997] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 782.179636] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.179860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.179860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.180067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.180253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.188874] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.189062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.189139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.189413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.189599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.191302] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 782.201602] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: IN_PROGRESS for 2s [ 782.247249] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.247537] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.247616] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.247899] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.248259] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.248433] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.248552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.248827] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.248978] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.249350] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.249350] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.249426] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.249520] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.249630] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 782.249738] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.249878] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.275482] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.275711] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 782.275836] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.276552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.276552] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f6f8a494-bea7-45ef-8246-fcf93ac667bf taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.276859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.276859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.277212] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.277389] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f8a494-bea7-45ef-8246-fcf93ac667bf',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.295894] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.296348] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.297439] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.779946] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.780240] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.780350] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.780625] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.780797] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.780937] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f6f8a494-bea7-45ef-8246-fcf93ac667bf not found, creating... [ 782.781215] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.781369] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.781487] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.781808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.781960] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.782253] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.782408] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.782522] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.782730] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.782860] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.783066] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f6f8a494-bea7-45ef-8246-fcf93ac667bf is going to be created. [ 782.797400] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.798215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.798294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.798495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.798600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.798702] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 is going to be updated. [ 782.800038] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.800152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.800209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.800377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.800462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.800540] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 782.802470] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.802585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.802654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.802809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.802886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.802972] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72b6db75-4b87-4e7a-a83d-588864639612 is going to be created. [ 782.805341] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.805573] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.805724] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.806205] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.806423] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.806631] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.832413] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.832555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.832627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.832886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.833074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.835126] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.835273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.835314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.835481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.835604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.837382] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.837497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.837570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.837727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.837843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.846991] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 782.847604] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: IN_PROGRESS for 2s [ 782.848557] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72b6db75-4b87-4e7a-a83d-588864639612 in Status: UNINITIALIZED for 2s [ 783.393736] env[70287]: INFO networking_nsxv3.common.synchronization [None req-33ece0e3-84e4-44d4-8871-fe4b80b903ac tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_rules [ 783.394370] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_rules [ 783.394735] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-306ade67-3f30-492d-a51d-d4eb542da01d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.394891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.394986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.396507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.396624] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.545912] env[70287]: INFO networking_nsxv3.common.synchronization [None req-6e861bb1-01e9-401e-bf0f-2abcd15224a9 tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_rules [ 783.548162] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_rules [ 783.548162] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-306ade67-3f30-492d-a51d-d4eb542da01d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.548162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.817874] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: SUCCESS [ 783.819177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.903613] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7430cb9-69a2-4026-a05a-5cc66d40bf27 req-b0e14ca1-9929-43d4-8871-61a7ad8c27c7 service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 783.904421] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7430cb9-69a2-4026-a05a-5cc66d40bf27 req-b0e14ca1-9929-43d4-8871-61a7ad8c27c7 service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 783.908174] env[70287]: INFO networking_nsxv3.common.synchronization [req-a7430cb9-69a2-4026-a05a-5cc66d40bf27 req-b0e14ca1-9929-43d4-8871-61a7ad8c27c7 service nova] Enqueued Resource ID: f6f8a494-bea7-45ef-8246-fcf93ac667bf with Priority: HIGHEST for action port [ 783.908174] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 783.908174] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 783.908174] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6f8a494-bea7-45ef-8246-fcf93ac667bf with Priority: HIGHEST for action port [ 783.908174] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.908174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.908174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.908174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.908174] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.908494] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.908494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.909717] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6f8a494-bea7-45ef-8246-fcf93ac667bf taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.909717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.909717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.909717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.909717] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6f8a494-bea7-45ef-8246-fcf93ac667bf',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.928158] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.928583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.928583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.928707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.928707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.928801] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 306ade67-3f30-492d-a51d-d4eb542da01d already deleted. [ 783.928885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.929443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.929651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.929758] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.048045] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: SUCCESS [ 784.048652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.049172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.049172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.049369] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.049517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.049612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.049820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.049938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.050062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.050209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.207063] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 784.207177] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 deletion is rescheduled due to dependency. [ 784.208361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.208361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.208361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.208361] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.208361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.208361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.208361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.208361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.208361] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.214137] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: SUCCESS [ 784.215467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.215467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.215467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.215467] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.411322] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.411884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.415023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6f8a494-bea7-45ef-8246-fcf93ac667bf with status ACTIVE [ 784.415023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.415023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.415023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.415023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.415023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6f8a494-bea7-45ef-8246-fcf93ac667bf is going to be updated. [ 784.449203] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.451172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.451277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.451555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.451823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.452047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6f8a494-bea7-45ef-8246-fcf93ac667bf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.453057] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.453228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.453336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.453557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.453701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.453829] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 306ade67-3f30-492d-a51d-d4eb542da01d already deleted. [ 784.453949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.556622] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.556795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.556872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.557101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.557262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.557372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.557432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.557595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.557677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.557771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.557918] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.558024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.559096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.559096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.559096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.559096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.559096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.559096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.559096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.559096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.559096] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.710943] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.718286] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.718374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.768786] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7f8e8c52-275b-49e5-8cb5-68b042b4ab82 None None] Enqueued Resource ID: 41c7fbd8-f469-44a8-a4c7-234a52adb2b7 with Priority: HIGHEST for action port [ 784.772249] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41c7fbd8-f469-44a8-a4c7-234a52adb2b7 with Priority: HIGHEST for action port [ 784.772662] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-41c7fbd8-f469-44a8-a4c7-234a52adb2b7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.772867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41c7fbd8-f469-44a8-a4c7-234a52adb2b7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.773713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41c7fbd8-f469-44a8-a4c7-234a52adb2b7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.773713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41c7fbd8-f469-44a8-a4c7-234a52adb2b7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.774222] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41c7fbd8-f469-44a8-a4c7-234a52adb2b7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.796224] env[70287]: INFO networking_nsxv3.common.synchronization [req-278b4149-c6fd-44a9-a001-eddf9ffc6741 req-5fe2562d-36e9-4eba-b6e0-c620d57ded1b tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 784.797472] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 784.798389] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.800017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.800017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.800017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.800017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.800017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.800017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.800017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.800017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.800017] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.859275] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 784.859531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.859639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.859850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.860045] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.860165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.860228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.860377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.860455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.860635] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.865018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72b6db75-4b87-4e7a-a83d-588864639612 in Status: SUCCESS [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.865018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: SUCCESS [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.865018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.865018] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.865018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.865663] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.865663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.865663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.865663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.865663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.865663] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.063762] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for df66c1e2-6914-41c1-a5ac-eb133438cab6: rpc.has_security_group_logging(os_id): False [ 785.081882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.081882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.081882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.082121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.082121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.082309] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.082412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.082468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.082621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.082696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.082878] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.082974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.084187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.084187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.084187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.084187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.084187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.084187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.084187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.084187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.084187] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be updated. [ 785.156301] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.156481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.156528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.156807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.156966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.171581] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: IN_PROGRESS for 2s [ 785.213292] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.280542] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41c7fbd8-f469-44a8-a4c7-234a52adb2b7 [ 785.280542] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.280542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.280542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.280542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.280542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.280542] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41c7fbd8-f469-44a8-a4c7-234a52adb2b7 already deleted. [ 785.280542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41c7fbd8-f469-44a8-a4c7-234a52adb2b7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.302057] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.304097] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.304097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.304097] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 785.336099] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.336099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.336099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.336099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.336099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.348614] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 785.362828] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.367214] env[70287]: INFO networking_nsxv3.common.synchronization [req-555c7949-1abd-4682-8937-456498012433 req-88b5aab1-154b-4cdb-ba2b-bd3a590003ef tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 785.367347] env[70287]: INFO networking_nsxv3.common.synchronization [req-555c7949-1abd-4682-8937-456498012433 req-88b5aab1-154b-4cdb-ba2b-bd3a590003ef tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 785.367482] env[70287]: INFO networking_nsxv3.common.synchronization [req-555c7949-1abd-4682-8937-456498012433 req-88b5aab1-154b-4cdb-ba2b-bd3a590003ef tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_members [ 785.368073] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.368871] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.369753] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 785.369825] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 with Priority: HIGHEST for action security_group_members [ 785.369908] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72b6db75-4b87-4e7a-a83d-588864639612 with Priority: HIGHEST for action security_group_members [ 785.370451] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.370553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.370978] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.371092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.371769] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-72b6db75-4b87-4e7a-a83d-588864639612 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.371872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.718603] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.718603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.718603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.718603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.718603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.718603] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 785.746837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.746837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.746837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.746837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.746837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.755788] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 785.865666] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.871224] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.875992] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.370064] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.373424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.374192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.374192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.374192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.374192] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 786.378820] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.378820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.378820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.378820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.378820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.379281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 is going to be updated. [ 786.380566] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.380721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.380831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.381109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.381255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.381403] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72b6db75-4b87-4e7a-a83d-588864639612 is going to be updated. [ 786.405350] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.405554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.406187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.406484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.407395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.411125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.411125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.411125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.411125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.411125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.413126] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.413247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.413312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.413484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.413615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.425861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 786.425938] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: IN_PROGRESS for 2s [ 786.430031] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72b6db75-4b87-4e7a-a83d-588864639612 in Status: IN_PROGRESS for 2s [ 786.727610] env[70287]: INFO networking_nsxv3.common.synchronization [req-374678de-f072-4d50-acd8-5ba132dca820 req-3bfce95d-e4c9-4caf-8145-c7f45af220b8 tempest-AttachInterfacesV270Test-1336614793 tempest-AttachInterfacesV270Test-1336614793-project-member] Enqueued Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_members [ 786.728223] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_members [ 786.728378] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.728501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.728572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.729110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.729110] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.729207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.729283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.729469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.729469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.729597] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.084062] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ce5a011a-86db-4dc3-8251-2eeea8df1d3a None None] Enqueued Resource ID: bbf9d009-5d1c-4ed9-9c24-75195271ea5a with Priority: HIGHEST for action port [ 787.084062] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf9d009-5d1c-4ed9-9c24-75195271ea5a with Priority: HIGHEST for action port [ 787.084062] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbf9d009-5d1c-4ed9-9c24-75195271ea5a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.084062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbf9d009-5d1c-4ed9-9c24-75195271ea5a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.084062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbf9d009-5d1c-4ed9-9c24-75195271ea5a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.084062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbf9d009-5d1c-4ed9-9c24-75195271ea5a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.084062] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf9d009-5d1c-4ed9-9c24-75195271ea5a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.193144] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: SUCCESS [ 787.193381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.233177] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.233177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.233177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.233488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.233587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.233858] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.233950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.234018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.234229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.234286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.234354] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 already deleted. [ 787.234432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.238369] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.238563] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-744" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.238683] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-744" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.239046] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-744" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.240057] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.240057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.240057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.240057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.240057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.240057] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.240653] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 787.240857] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 787.241007] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 787.241608] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 787.242147] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 787.242147] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 787.266672] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 787.266831] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 787.266968] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 787.267161] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-744" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.267489] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-710e56c0-4716-49ee-afa5-93e73df6806c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.267667] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.267787] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.268131] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.268266] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710e56c0-4716-49ee-afa5-93e73df6806c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.332068] env[70287]: INFO networking_nsxv3.common.synchronization [req-34b7ea36-6262-4f48-ae50-1e64ed59aad1 req-70569cf7-855d-48d7-b470-2106bc0e53ea tempest-ServersWithSpecificFlavorTestJSON-185056864 tempest-ServersWithSpecificFlavorTestJSON-185056864-project-member] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 787.332734] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 787.333712] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.334107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.334193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.334397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.334555] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.334691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.334739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.334896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.334993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.335104] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.358379] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 787.358379] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 787.358511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.540300] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.540300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.540300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.540476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.540947] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.593508] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bbf9d009-5d1c-4ed9-9c24-75195271ea5a [ 787.594108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.594108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.594108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.594336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.594336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.594415] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bbf9d009-5d1c-4ed9-9c24-75195271ea5a already deleted. [ 787.594455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbf9d009-5d1c-4ed9-9c24-75195271ea5a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.764743] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 787.764961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.765097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.765306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.765497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.765609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.765675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.765833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.765912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.766774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.766774] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.773377] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.773377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.773377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.773377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.773377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.773377] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 710e56c0-4716-49ee-afa5-93e73df6806c not found, creating... [ 787.773646] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.773646] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.773810] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.773990] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.774144] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.774423] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.774577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.774698] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.774902] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.776081] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.776299] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 710e56c0-4716-49ee-afa5-93e73df6806c is going to be created. [ 787.793789] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.794025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.794155] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.794428] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.794653] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.794908] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.837576] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.837754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.837824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.838049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.838157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.838339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.838435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.838493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.838663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.838742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.838842] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 is going to be updated. [ 787.892763] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.892763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.892763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.892763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.892763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.902907] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: IN_PROGRESS for 2s [ 788.044110] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.269775] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.270105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.270105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.270751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.270843] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.271026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.271366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.271538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.271613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.271668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.271815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.272090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.272143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.272250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.272321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.272401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.272500] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.441324] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 72b6db75-4b87-4e7a-a83d-588864639612 in Status: SUCCESS [ 788.441324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.441324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.441324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.441324] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.441324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.441324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.441728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.441728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.441728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.441830] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.445813] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: SUCCESS [ 788.445813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.445813] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 788.445813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.445813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.445813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.446116] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.446173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.446247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.446480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.446480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.446638] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.447870] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.448036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.448217] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.448339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.448423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.448590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.448590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.448690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.448821] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.452577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.452577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.452577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.452577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.453304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.453304] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.457019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.457019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.457019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.457019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.457019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.551399] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.778023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5344b0-d8f6-49cd-abc4-1a415b3aa399: rpc.has_security_group_logging(os_id): False [ 788.797440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.797440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.797440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.797440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.798032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.798032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.798032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.798032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.798234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.798340] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 788.813761] env[70287]: INFO networking_nsxv3.common.synchronization [req-374678de-f072-4d50-acd8-5ba132dca820 req-03da6666-69c7-40eb-9197-54dccade6df2 service nova] Enqueued Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_rules [ 788.813761] env[70287]: INFO networking_nsxv3.common.synchronization [req-374678de-f072-4d50-acd8-5ba132dca820 req-03da6666-69c7-40eb-9197-54dccade6df2 service nova] Enqueued Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_members [ 788.814071] env[70287]: INFO networking_nsxv3.common.synchronization [req-374678de-f072-4d50-acd8-5ba132dca820 req-03da6666-69c7-40eb-9197-54dccade6df2 service nova] Enqueued Resource ID: 710e56c0-4716-49ee-afa5-93e73df6806c with Priority: HIGHEST for action port [ 788.814583] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_rules [ 788.814583] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_members [ 788.814583] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 710e56c0-4716-49ee-afa5-93e73df6806c with Priority: HIGHEST for action port [ 788.816591] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.816591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.816591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.816591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.816591] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.817341] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.817409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.817409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.818478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.818478] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.818478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.818478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.818478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.818478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.818478] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.818910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-710e56c0-4716-49ee-afa5-93e73df6806c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.819027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.819089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.819265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.819336] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('710e56c0-4716-49ee-afa5-93e73df6806c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.856169] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.856399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.856399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.856589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.856731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.868926] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 788.949049] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.949155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.949228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.949454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.949548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.949745] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.949845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.949911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.950119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.950208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.950297] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 72b6db75-4b87-4e7a-a83d-588864639612 is going to be deleted. [ 788.951613] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e6ce8eb0-1f95-4fbe-ad32-829aa60405a9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.955902] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e57bed-6bad-4f87-86dc-05486c964c31: rpc.has_security_group_logging(os_id): False [ 788.955902] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('72b6db75-4b87-4e7a-a83d-588864639612',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.956702] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.956823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.956888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.957075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.957155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.957328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.957431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.957485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.957782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.957782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.957782] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 is going to be updated. [ 788.958691] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.979218] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.979383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.979450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.980755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.980755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.980755] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.980755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.980755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.980755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.980755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.980755] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.982247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.982247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.982247] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 789.032847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.032847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.032847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.032847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.032847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.044024] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: IN_PROGRESS for 2s [ 789.054198] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 789.054290] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 789.077719] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.078016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.078177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.078467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.080711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.087435] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.087435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.087435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.087435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.087435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.087435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.102410] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 789.323310] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.323586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.323625] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 710e56c0-4716-49ee-afa5-93e73df6806c with status ACTIVE [ 789.323834] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.323966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.324012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.324226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.324913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.324913] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.328244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.328342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.328587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.328689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.328899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.329026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.329100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.329282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.329371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.329461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 710e56c0-4716-49ee-afa5-93e73df6806c is going to be updated. [ 789.340035] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.362888] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.363062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.363189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.363395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.363510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.363672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-710e56c0-4716-49ee-afa5-93e73df6806c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.453867] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e6ce8eb0-1f95-4fbe-ad32-829aa60405a9: rpc.has_security_group_logging(os_id): False [ 789.457466] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 72b6db75-4b87-4e7a-a83d-588864639612: rpc.has_security_group_logging(os_id): False [ 789.460843] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.477157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.477469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.477469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.477692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.477795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.478029] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.479032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.479032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.479032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.479032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.479032] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72b6db75-4b87-4e7a-a83d-588864639612 is going to be created. [ 789.481674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.481811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.481885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.482062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.482144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.482347] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.482445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.482505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.482652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.482730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.482814] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 is going to be updated. [ 789.521985] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/72b6db75-4b87-4e7a-a83d-588864639612], does not exist path=[/infra/domains/default/groups/72b6db75-4b87-4e7a-a83d-588864639612]."\n}' [ 789.522173] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72b6db75-4b87-4e7a-a83d-588864639612 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/72b6db75-4b87-4e7a-a83d-588864639612 [ 789.522292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 789.563715] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.566177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.566177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.566177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.566177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.568552] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.568715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.568715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.568893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.570345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.570576] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.570711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.571220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.571220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.571220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.571220] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.571392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.571392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.571514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.571584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.571645] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 72b6db75-4b87-4e7a-a83d-588864639612 is going to be created. [ 789.579729] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: IN_PROGRESS for 2s [ 789.588030] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/72b6db75-4b87-4e7a-a83d-588864639612], does not exist path=[/infra/domains/default/groups/72b6db75-4b87-4e7a-a83d-588864639612]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/72b6db75-4b87-4e7a-a83d-588864639612 [ 789.588316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-72b6db75-4b87-4e7a-a83d-588864639612" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.588885] env[70287]: Traceback (most recent call last): [ 789.588931] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 789.588931] env[70287]: return func(*args, **kwargs) [ 789.588931] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 789.588931] env[70287]: res.raise_for_status() [ 789.588931] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 789.588931] env[70287]: raise HTTPError(http_error_msg, response=self) [ 789.588931] env[70287]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/72b6db75-4b87-4e7a-a83d-588864639612 [ 789.588931] env[70287]: During handling of the above exception, another exception occurred: [ 789.588931] env[70287]: Traceback (most recent call last): [ 789.589242] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 789.589242] env[70287]: listener.cb(fileno) [ 789.589242] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 789.589242] env[70287]: result = function(*args, **kwargs) [ 789.589242] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 789.589242] env[70287]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 789.589242] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 789.589242] env[70287]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 789.589242] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 789.589242] env[70287]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 789.589242] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 789.589242] env[70287]: res.raise_for_status() [ 789.589242] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 789.589242] env[70287]: raise HTTPError(http_error_msg, response=self) [ 789.589242] env[70287]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/72b6db75-4b87-4e7a-a83d-588864639612 [ 789.589242] env[70287]: Removing descriptor: 28 [ 789.844282] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.913592] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: SUCCESS [ 789.913592] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 deletion is rescheduled due to dependency. [ 789.913592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.963394] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.966047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.966047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.966047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.966047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.966047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 790.073992] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.074167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.074370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.074457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.074617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.084234] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 790.241784] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.241987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.242340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.242340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.256589] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 790.257360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.258592] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 790.289837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.290087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.290182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.290597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.297698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.298268] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 790.298402] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.298402] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 790.326709] env[70287]: INFO networking_nsxv3.common.synchronization [None req-56e3eefc-51ad-4271-99fa-a36101226a7b None None] Enqueued Resource ID: 9413f247-972b-462d-b6ea-8e9d6020394a with Priority: HIGHEST for action port [ 790.326975] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9413f247-972b-462d-b6ea-8e9d6020394a with Priority: HIGHEST for action port [ 790.328024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9413f247-972b-462d-b6ea-8e9d6020394a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.328024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9413f247-972b-462d-b6ea-8e9d6020394a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.328024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9413f247-972b-462d-b6ea-8e9d6020394a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.328024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9413f247-972b-462d-b6ea-8e9d6020394a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.328024] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9413f247-972b-462d-b6ea-8e9d6020394a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.334989] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.334989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.334989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.334989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.335839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.336159] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 790.346487] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.346699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.346699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.346897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.346977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.347103] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 is going to be created. [ 790.378009] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.378116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.378169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.378367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.378988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.388477] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 in Status: UNINITIALIZED for 2s [ 790.412610] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.412839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.412839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.413168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.413281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.413501] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 790.546442] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.546874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.547150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.547579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.548027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.548509] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:41. [ 790.548774] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a3a03bdb-ddb5-4fa6-b2d1-eed110e58313', '5c308c6c-418c-4781-8979-52bfbe3999bc', '5a071b3c-2494-4d97-804e-6e2eca010b22', 'a4de514c-a329-428e-aef2-824011ac27e1', '64eebc83-d0e6-4418-b651-efae0fdea09b', '33f97a48-67cf-4681-a4ae-50c22c693573', 'aafb90fc-938c-44be-9296-60863884f367', '84f1f591-bba8-479c-a2de-cf9524dceb77', '30d31850-1f11-444e-b895-cf073f4e7ffc', '7ca57bd1-00de-4346-9352-680cd5a5d975', '68e57bed-6bad-4f87-86dc-05486c964c31', '3c4fea80-b8d6-423e-9f82-93c6ef731d08', 'd6d080df-987c-42ee-a1c4-0bd34532e799', '9e5344b0-d8f6-49cd-abc4-1a415b3aa399', 'cbadb315-bfe6-4947-b23f-861ec4456d95', '7e5e0f30-956b-4713-b190-79d66c86985e', '96287f57-8a87-4086-ac4e-214b416b0677', '103dc013-133c-4ce6-897f-dbfb9383e30c', '6dd050a9-748f-4acb-8e46-7e66c72189cc', 'fab56e40-0f11-4047-a55f-7256f2c35ef8', 'df66c1e2-6914-41c1-a5ac-eb133438cab6', '66c1d37b-c5db-46f6-a3a7-fba9859cd91e', '3fa85bd5-519a-4ab3-885c-dd87b56fc10a', 'd87c2dce-8258-430c-b549-6c6bfe5f0943', '1bd48e89-cc58-4469-862d-723098d8ef49', '10ebe6dc-47f0-434b-95e1-44ef22b9a387', 'aace6632-4a31-4f49-8463-d0be4cce8713', 'ac98ad7d-21c7-4c9e-add9-9d7467bf4897', 'c7801a11-9fa5-48e7-852a-cce31e8a5030', '3e02cb19-0821-42f3-a922-f67afc4bab0d', '03f7a97c-14e5-4707-a109-e07660e131ff', 'e268cb7c-d939-4cae-9df0-54709ed24656', '3fe525ed-6fed-4da6-b1de-de2234e26337', 'f23e3805-622c-45be-b03e-1e0963f7a65e', 'e6ce8eb0-1f95-4fbe-ad32-829aa60405a9', '0c8498fc-c714-4100-81f9-c85ac268aab7', 'b7e1295d-86bf-45fa-b2c1-808d7d01f3ea', 'eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40', 'd3161f57-5a3e-445b-998a-3e587c1ae1d7', '6326b8c2-c4f1-4b56-863e-ab5aeeaf035d', '02bff0b8-b4e7-47de-bf5e-9f794b64958a'} {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.549139] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 790.577716] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.577716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.577716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.577716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.577716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.577716] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 790.577716] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.577716] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 790.678385] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.678602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.678698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.678957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.679791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.680050] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 790.680129] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.680200] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 790.680264] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 790.680344] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/41 resources of Type:Security Group Rules [ 790.680410] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGH for action security_group_rules [ 790.680484] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGH for action security_group_rules [ 790.680548] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGH for action security_group_rules [ 790.680623] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGH for action security_group_rules [ 790.680717] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGH for action security_group_rules [ 790.680754] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGH for action security_group_rules [ 790.680784] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGH for action security_group_rules [ 790.680842] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGH for action security_group_rules [ 790.680905] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGH for action security_group_rules [ 790.681041] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGH for action security_group_rules [ 790.681041] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGH for action security_group_rules [ 790.681107] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGH for action security_group_rules [ 790.681208] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGH for action security_group_rules [ 790.681284] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGH for action security_group_rules [ 790.681355] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGH for action security_group_rules [ 790.681407] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGH for action security_group_rules [ 790.681469] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGH for action security_group_rules [ 790.681581] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGH for action security_group_rules [ 790.681581] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGH for action security_group_rules [ 790.681752] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGH for action security_group_rules [ 790.681802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.832035] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9413f247-972b-462d-b6ea-8e9d6020394a [ 790.832035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.832228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.832228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.832372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.832751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.832751] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9413f247-972b-462d-b6ea-8e9d6020394a already deleted. [ 790.832751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9413f247-972b-462d-b6ea-8e9d6020394a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.899534] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 790.899954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.050849] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: SUCCESS [ 791.051043] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 deletion is rescheduled due to dependency. [ 791.051156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.116248] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 791.116507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.116684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.116903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.116993] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.592496] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e6ce8eb0-1f95-4fbe-ad32-829aa60405a9 in Status: SUCCESS [ 791.592745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e6ce8eb0-1f95-4fbe-ad32-829aa60405a9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.622093] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.622245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.682023] env[70287]: INFO networking_nsxv3.common.synchronization [None req-2525c976-7183-49af-a2e7-51512acf6429 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 791.682023] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 791.682023] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 with Priority: HIGH for action security_group_rules [ 791.682023] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 with Priority: HIGH for action security_group_rules [ 791.682023] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGH for action security_group_rules [ 791.682023] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbadb315-bfe6-4947-b23f-861ec4456d95 with Priority: HIGH for action security_group_rules [ 791.682023] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGH for action security_group_rules [ 791.682444] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGH for action security_group_rules [ 791.682444] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGH for action security_group_rules [ 791.682517] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGH for action security_group_rules [ 791.682552] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGH for action security_group_rules [ 791.682660] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGH for action security_group_rules [ 791.682726] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6d080df-987c-42ee-a1c4-0bd34532e799 with Priority: HIGH for action security_group_rules [ 791.682809] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGH for action security_group_rules [ 791.682904] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGH for action security_group_rules [ 791.682985] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 with Priority: HIGH for action security_group_rules [ 791.683078] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d31850-1f11-444e-b895-cf073f4e7ffc with Priority: HIGH for action security_group_rules [ 791.683162] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGH for action security_group_rules [ 791.683243] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGH for action security_group_rules [ 791.683326] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64eebc83-d0e6-4418-b651-efae0fdea09b with Priority: HIGH for action security_group_rules [ 791.683408] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c308c6c-418c-4781-8979-52bfbe3999bc with Priority: HIGH for action security_group_rules [ 791.683490] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGH for action security_group_rules [ 791.683838] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.683993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.684068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.684304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.684387] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.685221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.685347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.685400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.685560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.685916] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a3a03bdb-ddb5-4fa6-b2d1-eed110e58313',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.686740] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a071b3c-2494-4d97-804e-6e2eca010b22 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.686854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.686915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.687080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.687155] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a071b3c-2494-4d97-804e-6e2eca010b22',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.687792] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.687907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.688134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.688134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.688242] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.689176] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbadb315-bfe6-4947-b23f-861ec4456d95 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.689284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.689352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.689501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.689573] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbadb315-bfe6-4947-b23f-861ec4456d95',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.690514] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.690620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.690680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.690826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.690902] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.691881] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.692043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.692090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.692214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.692286] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.693096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.693205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.693273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.693423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.693494] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.694316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.694432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.694495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.694794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.694794] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.695610] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.695610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.695768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.695768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.695855] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.696822] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.696929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.696992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.697157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.697227] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.697746] env[70287]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 791.698430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6d080df-987c-42ee-a1c4-0bd34532e799 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.698857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.698857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.698857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.698857] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6d080df-987c-42ee-a1c4-0bd34532e799',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.699591] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.699689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.699792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.699897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.699969] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.700853] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.700946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.701145] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ca57bd1-00de-4346-9352-680cd5a5d975 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.701397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.701601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.701780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.701861] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ca57bd1-00de-4346-9352-680cd5a5d975',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.702648] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d31850-1f11-444e-b895-cf073f4e7ffc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.702756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.702821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.702968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.703056] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d31850-1f11-444e-b895-cf073f4e7ffc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.703938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.704053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.704053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.704248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.704248] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.705651] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.705997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.706137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.706485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.706614] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.708123] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64eebc83-d0e6-4418-b651-efae0fdea09b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.708265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.708357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.708557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.708656] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64eebc83-d0e6-4418-b651-efae0fdea09b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.709742] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5c308c6c-418c-4781-8979-52bfbe3999bc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.709914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.710020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.710450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.710820] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5c308c6c-418c-4781-8979-52bfbe3999bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.711998] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.712177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.712283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.712516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.712629] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.744406] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.744708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.744708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.744847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.747183] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.747183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.748535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.748634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.766584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.766686] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a071b3c-2494-4d97-804e-6e2eca010b22 is going to be deleted. [ 791.768193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.768499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.768605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.768709] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f already deleted. [ 791.768808] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.769061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.769155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.785491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.785625] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a3a03bdb-ddb5-4fa6-b2d1-eed110e58313 is going to be deleted. [ 791.825966] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.826206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.826257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.826500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.826599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.826728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a071b3c-2494-4d97-804e-6e2eca010b22" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.833798] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.833912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.834474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.834474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.834474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.834474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a3a03bdb-ddb5-4fa6-b2d1-eed110e58313" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.877461] env[70287]: INFO networking_nsxv3.common.synchronization [None req-262cf841-9d75-44de-9ac1-536ec9618212 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 791.878568] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 791.878568] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.878568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.878745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.878838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.878871] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.953327] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7613238-0b99-4b52-8075-e134db348be1 req-0fc9398c-ae02-411c-9177-6931917158d9 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 791.953910] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 791.954956] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.954956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.954956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.954956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.954956] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.955194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.955194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.955352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.955409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.955590] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.094650] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 792.095551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.095728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.095948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.096160] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.096274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.096337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.096496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.096571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.096654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.096785] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.244058] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.244670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.244670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.244670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.244988] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.244988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.244988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.245112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.245145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.245240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.245329] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.247105] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.247204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.247271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.247978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.248124] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.248124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.248218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.248350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.248463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.248549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.248631] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.250350] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.250350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.250536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.250640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.250748] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.250946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.250946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.251489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.251489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.251489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.251657] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.252972] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.255910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.255910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.255910] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.256554] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.256554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.256554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.256554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.256713] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.256977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.256977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.256977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.257121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.257121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.257275] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.257994] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.258222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.258222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.258338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.258463] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.258670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.258670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.258768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.258828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.258912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.259040] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.262234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.262430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.262430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.263495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.263495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.263495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.263495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.263495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.263495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.263495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.263495] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.264861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.264861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.264861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.265059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.265159] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.265415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.265415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.265415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.265541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.265574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.265655] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.269701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.269701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.269701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.270074] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.279334] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.279566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.279566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.279732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.279882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.279975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.280474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.280474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.280474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.280474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.280474] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.280712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.280712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.280712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.280955] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.280955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.281075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.281125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.281576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.281576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.281576] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.282413] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.284237] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.303836] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.303983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.304146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.304402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.306328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.306449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.307127] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.307277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.307982] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.308086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.309650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.309745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.313712] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.313926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.314744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.314861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.315602] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.315698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.317954] env[70287]: INFO networking_nsxv3.common.synchronization [req-cd531d8b-7e50-42b0-a48f-672d29cb3cc2 req-0e98edd6-978d-4ff9-801e-a9dc5e5c7c24 tempest-FloatingIPsAssociationTestJSON-116958673 tempest-FloatingIPsAssociationTestJSON-116958673-project-member] Enqueued Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 792.318418] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 with Priority: HIGHEST for action security_group_members [ 792.318914] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-10ebe6dc-47f0-434b-95e1-44ef22b9a387 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.318987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.319341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.319341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.319439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.319484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.319608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.320027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.320027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.320027] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10ebe6dc-47f0-434b-95e1-44ef22b9a387',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.322616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.322725] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ca57bd1-00de-4346-9352-680cd5a5d975 is going to be deleted. [ 792.326169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.326169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.342576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.342576] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d31850-1f11-444e-b895-cf073f4e7ffc is going to be deleted. [ 792.342576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.342576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.365990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.366702] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6d080df-987c-42ee-a1c4-0bd34532e799 is going to be deleted. [ 792.368102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.368102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.380569] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.380569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.387128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.387128] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5c308c6c-418c-4781-8979-52bfbe3999bc is going to be deleted. [ 792.387904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.388276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.401872] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 in Status: SUCCESS [ 792.401872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.402088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.403209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.403209] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.403209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.403209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.403209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.403209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.403209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.403209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.426508] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.426508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.427507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.427507] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be deleted. [ 792.430624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.430624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.440334] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.440441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.442634] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.442634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.456300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.456300] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64eebc83-d0e6-4418-b651-efae0fdea09b is going to be deleted. [ 792.456300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.456300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.457432] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.457537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.462182] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.462555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.462648] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.462911] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.463204] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.463357] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.463473] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.463743] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.463940] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.464197] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.464342] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.464582] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.464739] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.464897] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 792.465039] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.465381] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.477846] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.477956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.490442] env[70287]: INFO networking_nsxv3.common.synchronization [None req-0073bbcf-c4ff-4ae4-a43d-203474467cf1 None None] Enqueued Resource ID: ec185887-5ba0-4edd-8415-68ef1a776dc8 with Priority: HIGHEST for action port [ 792.490442] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec185887-5ba0-4edd-8415-68ef1a776dc8 with Priority: HIGHEST for action port [ 792.490960] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec185887-5ba0-4edd-8415-68ef1a776dc8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.491074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec185887-5ba0-4edd-8415-68ef1a776dc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.491118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec185887-5ba0-4edd-8415-68ef1a776dc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.491399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec185887-5ba0-4edd-8415-68ef1a776dc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.491492] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec185887-5ba0-4edd-8415-68ef1a776dc8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.636087] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.636389] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.171 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 792.636389] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.636636] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.637365] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-fdba838f-32dc-4cd3-a8b3-5fc866301e68 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.637365] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.637365] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.641120] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.641120] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdba838f-32dc-4cd3-a8b3-5fc866301e68',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.641120] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.641120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.641120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.641120] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be deleted. [ 792.641602] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.641687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.641727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.642912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.642912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.642912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.643279] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.643279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.643368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.643476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.643613] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.643700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.643780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.643941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.644026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.644105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.644248] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.644326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.644380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.644512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.644637] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.644718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.644791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.644926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.644986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.645077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.645159] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.646102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.646487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.690183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.690387] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbadb315-bfe6-4947-b23f-861ec4456d95 is going to be deleted. [ 792.691542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.691823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.691879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.692055] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f already deleted. [ 792.692055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.692241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.692322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.692401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.692517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d31850-1f11-444e-b895-cf073f4e7ffc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.693030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.693196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.693302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.693425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6d080df-987c-42ee-a1c4-0bd34532e799" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.693556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.693694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.693795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.694014] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.694128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.694189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.694326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.694399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.694483] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be deleted. [ 792.695287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.695517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.695517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.695639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5c308c6c-418c-4781-8979-52bfbe3999bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.695763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.695904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.695986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.696119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64eebc83-d0e6-4418-b651-efae0fdea09b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.696649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.696752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.696818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.696932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ca57bd1-00de-4346-9352-680cd5a5d975" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.719611] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.719611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.719611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.719860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.719943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.720100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.720853] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.720934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.721018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.721224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.721308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.721401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.739271] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.739457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.739547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.739781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.739908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.740066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbadb315-bfe6-4947-b23f-861ec4456d95" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.754021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.755124] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.778274] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.778575] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.778575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.778720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.778854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.778945] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.779055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.779121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.779265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.779348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.779430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.780402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.780402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.780402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.781230] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.781420] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.781513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.782589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.782589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.782589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.783246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.783246] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.783246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.783246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.783246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.783246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.783246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.783486] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.785652] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.789574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96287f57-8a87-4086-ac4e-214b416b0677: rpc.has_security_group_logging(os_id): False [ 792.789574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5344b0-d8f6-49cd-abc4-1a415b3aa399: rpc.has_security_group_logging(os_id): False [ 792.789574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6dd050a9-748f-4acb-8e46-7e66c72189cc: rpc.has_security_group_logging(os_id): False [ 792.821887] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.822097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.822177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.822431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.824918] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.824918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.825530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.825650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.827060] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.827185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.867496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.870907] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.874051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.875799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.875799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.875799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.875799] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc is going to be updated. [ 792.875799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.876778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.910397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.910397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.910397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.910397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.910397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.910397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.910397] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 is going to be updated. [ 792.910397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.910397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.910397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.910795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.910795] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.910795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.910902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.911230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.911313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.911408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.911585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.911681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.913345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.913345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.913345] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.913345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.913345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.913345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.913345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.913345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.913345] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.914049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.914049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.937509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.937509] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.937509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.937509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.937509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.937509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.937509] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 is going to be updated. [ 792.938968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.940065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.942520] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.942667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.966590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.966907] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.966907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.967065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.970294] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.970294] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.970294] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.970294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.971313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.972237] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.972351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.972420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.972599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.972712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.983645] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: IN_PROGRESS for 2s [ 792.985879] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.985999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.986079] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.986262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.986825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.991618] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: IN_PROGRESS for 2s [ 792.996361] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: IN_PROGRESS for 2s [ 793.040892] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.041046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.041143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.041333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.041478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.081486] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 793.149535] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec185887-5ba0-4edd-8415-68ef1a776dc8 [ 793.149535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.149535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.149535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.149836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.149836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.149836] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec185887-5ba0-4edd-8415-68ef1a776dc8 already deleted. [ 793.149953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec185887-5ba0-4edd-8415-68ef1a776dc8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.150117] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e57bed-6bad-4f87-86dc-05486c964c31: rpc.has_security_group_logging(os_id): False [ 793.151428] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.151622] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.151789] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.151996] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.152154] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.152855] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port fdba838f-32dc-4cd3-a8b3-5fc866301e68 not found, creating... [ 793.152855] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.152855] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.152855] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.153273] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.153273] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.153447] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.153599] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.153717] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.153948] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.154117] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.154259] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: fdba838f-32dc-4cd3-a8b3-5fc866301e68 is going to be created. [ 793.186377] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.187122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.189162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.189420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.192801] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.192992] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.193154] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.193423] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.193838] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.194106] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.228474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.228643] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.228643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.228765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.228941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.229042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.229273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.229380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.229443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.229605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.229681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.230011] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.230011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.230011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.230180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.230568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.230568] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 793.257878] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33f97a48-67cf-4681-a4ae-50c22c693573: rpc.has_security_group_logging(os_id): False [ 793.258482] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4de514c-a329-428e-aef2-824011ac27e1: rpc.has_security_group_logging(os_id): False [ 793.278164] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.278164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.278164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.278412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.283030] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 103dc013-133c-4ce6-897f-dbfb9383e30c: rpc.has_security_group_logging(os_id): False [ 793.288176] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.288176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.288176] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 793.288669] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aafb90fc-938c-44be-9296-60863884f367: rpc.has_security_group_logging(os_id): False [ 793.289590] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c4fea80-b8d6-423e-9f82-93c6ef731d08: rpc.has_security_group_logging(os_id): False [ 793.326269] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.326406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.327193] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.327294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.327954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.328065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.337024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.337187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.340029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.340029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.340029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.340029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.340029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4de514c-a329-428e-aef2-824011ac27e1 is going to be updated. [ 793.340029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.340029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.340817] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.340928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.355555] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.355714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.386909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.387319] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.387449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.387509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.387713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.387794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.387892] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be updated. [ 793.388992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.389184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.416148] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e9d742c4-fcbc-4b69-9949-6ee5386d29e2: rpc.has_security_group_logging(os_id): False [ 793.426409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.426632] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.426760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.426828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.427053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.428053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.428053] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.428053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.428053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.428053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.428053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.428053] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.428053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.428053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.428540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.428540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.428540] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 793.429493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.429672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.456239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.456420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.462941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.463119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.471639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.471984] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.472121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.472376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.472450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.472513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.472848] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c is going to be updated. [ 793.473823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.473997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.474161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.475199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.475289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.514293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 793.528612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.528985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.529152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.529255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.529565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.529732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.530230] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.530306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.530359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.530900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.530900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.531168] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.531221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.531882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.531882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.531882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.532018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 793.533560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.534179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.534179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.534357] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.534530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.534644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.534888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.535032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.535339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.535499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.535604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.535833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.535967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.536287] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.536429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.536542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.536768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.536900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.537056] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 is going to be created. [ 793.538550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.538805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.539200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.541447] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.541595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.541741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.542198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.542198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.543460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.543706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.577861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.578043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.598051] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: IN_PROGRESS for 2s [ 793.599009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.601951] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.602281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.602368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.602570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.602663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.602766] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 793.603905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.604078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.604217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.628088] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: IN_PROGRESS for 2s [ 793.630748] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 793.692033] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.692033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.692033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.692033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.692526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.720324] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: IN_PROGRESS for 2s [ 793.732775] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.732945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.733016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.733221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.733370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.750529] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 793.764724] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.764961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.764961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.765198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.765375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.775023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.775197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.775258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.775435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.775580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.786385] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 in Status: IN_PROGRESS for 2s [ 793.795017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 794.044104] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7613238-0b99-4b52-8075-e134db348be1 req-3acc937c-4176-46d0-a975-9b48e95d626d service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 794.044216] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7613238-0b99-4b52-8075-e134db348be1 req-3acc937c-4176-46d0-a975-9b48e95d626d service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 794.044354] env[70287]: INFO networking_nsxv3.common.synchronization [req-d7613238-0b99-4b52-8075-e134db348be1 req-3acc937c-4176-46d0-a975-9b48e95d626d service nova] Enqueued Resource ID: fdba838f-32dc-4cd3-a8b3-5fc866301e68 with Priority: HIGHEST for action port [ 794.045787] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 794.045787] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 794.045787] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdba838f-32dc-4cd3-a8b3-5fc866301e68 with Priority: HIGHEST for action port [ 794.045787] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.045787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.045787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.045787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.046304] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.046640] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.048039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.048039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.048039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.048039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.048039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.048039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.048039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.048039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.048039] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.049126] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdba838f-32dc-4cd3-a8b3-5fc866301e68 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.049126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.049126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.049126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.049126] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdba838f-32dc-4cd3-a8b3-5fc866301e68',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.404724] env[70287]: INFO networking_nsxv3.common.synchronization [req-496fa31f-5224-48ca-982e-3bd717f6203e req-2cb4cb43-7e6c-4774-9d2a-69f7ec4cc0a5 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 794.405371] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 794.405589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.405715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.405778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.405974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.406147] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.406243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.406299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.406448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.406533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.406624] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.550279] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.551287] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.551395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.551567] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fdba838f-32dc-4cd3-a8b3-5fc866301e68 with status ACTIVE [ 794.551870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.551870] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.552021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.552113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.552202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.552370] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.552467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.552529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.552675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.552763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.552936] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.555337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.555420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.555609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.555728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.555833] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fdba838f-32dc-4cd3-a8b3-5fc866301e68 is going to be updated. [ 794.576338] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.579035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.579035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.580294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.580573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.580858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdba838f-32dc-4cd3-a8b3-5fc866301e68" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.874452] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.874757] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.878015] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.878015] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.878015] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.878015] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.878015] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.878015] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.878015] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.878015] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.878015] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.878015] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.878015] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.878015] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 794.878015] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.878015] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.896015] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.896345] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 794.896552] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.896786] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.897451] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-dc150b31-aa76-4b7d-b218-da3aa9c434bc taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.898309] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.898466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.898836] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.898985] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc150b31-aa76-4b7d-b218-da3aa9c434bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.909751] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.994679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 in Status: SUCCESS [ 794.995047] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10ebe6dc-47f0-434b-95e1-44ef22b9a387 deletion is rescheduled due to dependency. [ 794.995235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10ebe6dc-47f0-434b-95e1-44ef22b9a387" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.005975] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: SUCCESS [ 795.006215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.007037] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: SUCCESS [ 795.007214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.058372] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.095143] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 795.095143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.402294] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.402527] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.402655] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.402936] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.403099] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.403293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port dc150b31-aa76-4b7d-b218-da3aa9c434bc not found, creating... [ 795.403538] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.403729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.403943] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.404255] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.404412] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.404716] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.404904] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.405040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.405300] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.405446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.405589] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: dc150b31-aa76-4b7d-b218-da3aa9c434bc is going to be created. [ 795.412355] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.424129] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.424348] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.424478] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.424738] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.424973] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.425229] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.532688] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 795.532688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.532688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.532688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.532688] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.560874] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.561035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.561153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.561718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.561718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.561718] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be created. [ 795.590927] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.590927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.590927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.591349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.591349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.618013] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: UNINITIALIZED for 2s [ 795.624702] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: SUCCESS [ 795.626047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.644797] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 795.645073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.652666] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 795.652666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.733078] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: SUCCESS [ 795.733078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.767339] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 795.767727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.796186] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 in Status: SUCCESS [ 795.796396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.804979] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 795.805101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.917145] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.917145] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 795.945698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.945878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.945988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.946186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.946348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.955118] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 796.034872] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.035050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.035309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.035383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.035501] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.035596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.035656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.035794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.035875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.035960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.036294] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.351665] env[70287]: INFO networking_nsxv3.common.synchronization [req-496fa31f-5224-48ca-982e-3bd717f6203e req-1f6b5219-0e73-4a7e-b4f3-860abf510293 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 796.351804] env[70287]: INFO networking_nsxv3.common.synchronization [req-496fa31f-5224-48ca-982e-3bd717f6203e req-1f6b5219-0e73-4a7e-b4f3-860abf510293 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 796.351924] env[70287]: INFO networking_nsxv3.common.synchronization [req-496fa31f-5224-48ca-982e-3bd717f6203e req-1f6b5219-0e73-4a7e-b4f3-860abf510293 service nova] Enqueued Resource ID: dc150b31-aa76-4b7d-b218-da3aa9c434bc with Priority: HIGHEST for action port [ 796.352193] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 796.354339] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 796.354339] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc150b31-aa76-4b7d-b218-da3aa9c434bc with Priority: HIGHEST for action port [ 796.354339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.354339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.354339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.354339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.354339] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.354865] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.354865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.355249] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc150b31-aa76-4b7d-b218-da3aa9c434bc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.355399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.355488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.355701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.355924] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc150b31-aa76-4b7d-b218-da3aa9c434bc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.541204] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.541400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.541475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.541689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.541850] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.541949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.542011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.542176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.542268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.542356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.542645] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.542645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.542645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.543110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.543234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.543302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.543364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.543551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.543633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.543715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.543841] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.858339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.858513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.858738] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc150b31-aa76-4b7d-b218-da3aa9c434bc with status ACTIVE [ 796.858936] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.859084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.859765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.859765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.859765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.859765] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.860329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.860329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.860329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.860329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.860329] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.860678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.860678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.860678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.860894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.860894] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc150b31-aa76-4b7d-b218-da3aa9c434bc is going to be updated. [ 796.882638] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.882775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.882840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.883442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.883442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.883442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc150b31-aa76-4b7d-b218-da3aa9c434bc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.046525] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68e57bed-6bad-4f87-86dc-05486c964c31: rpc.has_security_group_logging(os_id): False [ 797.068260] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.068415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.068487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.068707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.069811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.069811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.069811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.069811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.069811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.069811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.069811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.069811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.069811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.070539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.070539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.070539] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.070539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.070539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.070539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.070539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.070539] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 797.132551] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.132698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.132767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.133110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.133288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.152639] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 797.627039] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 797.627263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.627425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.627713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.627897] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.628023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.628092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.628230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.628308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.628473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.628473] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.966642] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 797.966819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.966996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.967227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.967415] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.967588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.967632] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.967818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.967907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.968010] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.131193] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.131626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.131626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.131725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.131831] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.131929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.131992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.132238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.132334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.132453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.132616] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.132745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.132813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.133035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.133178] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.133273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.133332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.133468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.133552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.133638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.133728] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.469863] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.637029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1f591-bba8-479c-a2de-cf9524dceb77: rpc.has_security_group_logging(os_id): False [ 798.654221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.654482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.654587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.654698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.654904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.655077] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.655171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.655223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.655383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.655466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.655641] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.655773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.655814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.655924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.655994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.656195] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.656285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.656339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.656477] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.656549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.656626] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be created. [ 798.708576] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.708738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.708805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.709035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.709228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.723034] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 798.972468] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.172618] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 799.173026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.355409] env[70287]: INFO networking_nsxv3.common.synchronization [req-41474530-36c7-4783-b8a6-ab1e2e5ee13c req-729da0b5-43a7-4787-a593-081bf1e77b2d tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 799.356049] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 799.356403] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.356613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.356613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.356781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.356923] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.357038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.357142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.357276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.357358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.357449] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.484151] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.484151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.484151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.484151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.484151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.484151] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 799.510019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.517047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 799.833573] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.833785] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.833947] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.834856] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.835207] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.835397] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.835537] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.835816] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.835987] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.836212] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.836330] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.836444] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.836555] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.836664] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 799.836773] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.836773] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.860420] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.864057] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.864257] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 799.864398] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.864582] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.864926] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.865117] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.865248] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.865601] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.865752] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cacdd85-77fd-4e45-8bb0-4376cc61b0e7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.369617] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.371211] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.371463] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.371618] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.372077] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.372291] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.372471] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 not found, creating... [ 800.372804] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.373297] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.373591] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.374474] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.375738] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.376233] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.377509] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.377724] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.378312] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.378548] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.378760] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 is going to be created. [ 800.397934] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.398699] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.398699] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.398896] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.400039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.400039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.738192] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 800.738454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.883314] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.883314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.883314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.883314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.883314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.883314] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 800.917598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.917598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.917803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.918400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.918400] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.930799] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 801.280491] env[70287]: INFO networking_nsxv3.common.synchronization [req-41474530-36c7-4783-b8a6-ab1e2e5ee13c req-e49c1bc8-7198-4f3f-806c-9f484f0367d8 service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 801.280711] env[70287]: INFO networking_nsxv3.common.synchronization [req-41474530-36c7-4783-b8a6-ab1e2e5ee13c req-e49c1bc8-7198-4f3f-806c-9f484f0367d8 service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 801.280899] env[70287]: INFO networking_nsxv3.common.synchronization [req-41474530-36c7-4783-b8a6-ab1e2e5ee13c req-e49c1bc8-7198-4f3f-806c-9f484f0367d8 service nova] Enqueued Resource ID: 2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 with Priority: HIGHEST for action port [ 801.281970] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 801.285458] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 801.285618] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 with Priority: HIGHEST for action port [ 801.286058] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.286239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.287025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.287025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.287025] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.290023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.290023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.290023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.290023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.290023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.290023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.290023] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cacdd85-77fd-4e45-8bb0-4376cc61b0e7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.527611] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 801.527958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.527998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.528415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.528649] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.528802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.528904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.529121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.529234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.529345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.529491] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.792178] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.792365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.792568] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 with status ACTIVE [ 801.792758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.793650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.793650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.793650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.793650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.793650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.793650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.793650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.794083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.794083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.794302] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.794302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.794411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.795029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.795029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.795029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cacdd85-77fd-4e45-8bb0-4376cc61b0e7 is going to be updated. [ 801.814824] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.815114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.815197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.815530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.815636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.815795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cacdd85-77fd-4e45-8bb0-4376cc61b0e7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.032391] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.032619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.032753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.033104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.033370] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.033529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.033644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.033935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.034085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.034856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.035103] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.035246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.035452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.035669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.035883] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.036044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.037067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.037285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.037376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.037489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.037596] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.540671] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 802.563973] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.565031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.566375] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.566375] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.566375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.566771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.566771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.566771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.566911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.567066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.567066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.567186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.567272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.567355] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 802.597294] env[70287]: INFO networking_nsxv3.common.synchronization [req-38b9f8de-0089-4db4-946b-19f71c34abb3 req-a5de969a-d101-42f5-92fe-facd8c9223be tempest-VolumesAdminNegativeTest-1117785024 tempest-VolumesAdminNegativeTest-1117785024-project-member] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_members [ 802.597936] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGHEST for action security_group_members [ 802.598322] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.598477] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.598569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.598838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.599079] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.599211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.599296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.599664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.599664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.599772] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.624062] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.624236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.624676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.624676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.624676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.639121] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 802.941718] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 802.941981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.942171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.942405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.942589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.942704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.942761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.942924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.942999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.943118] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.101944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.103601] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.103601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.103601] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 is going to be updated. [ 803.128504] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.128650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.128722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.129058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.129144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.138018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: IN_PROGRESS for 2s [ 803.222932] env[70287]: INFO networking_nsxv3.common.synchronization [req-46ac094f-4857-4760-8f97-973b47bd87b5 req-0bbaca76-2392-4db1-9b9e-e57e1f722c9c tempest-AttachInterfacesV270Test-1336614793 tempest-AttachInterfacesV270Test-1336614793-project-member] Enqueued Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_members [ 803.223421] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGHEST for action security_group_members [ 803.223735] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.224198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.224198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.224319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.224659] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.224659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.224659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.224821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.224821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.226489] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.451017] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.728619] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.729183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.729183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.729183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.729318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.729427] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.729526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.729645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.729749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.729825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.729917] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 is going to be updated. [ 803.759747] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.759747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.759747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.759747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.759747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.767837] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 in Status: IN_PROGRESS for 2s [ 803.955459] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.458372] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.458537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.458610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.458833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.458927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.459043] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 804.486385] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.486668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.486668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.486819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.486971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.496017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 804.654696] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 804.654949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.150093] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96287f57-8a87-4086-ac4e-214b416b0677 in Status: SUCCESS [ 805.151260] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 deletion is rescheduled due to dependency. [ 805.151260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.152388] env[70287]: INFO networking_nsxv3.common.synchronization [req-d610cadd-e6c6-4db7-8035-abe3e09f4b7c req-c649db8f-ecb5-40fd-94ba-1af60b1177f8 tempest-VolumesAssistedSnapshotsTest-104473246 tempest-VolumesAssistedSnapshotsTest-104473246-project-member] Enqueued Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_members [ 805.153228] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGHEST for action security_group_members [ 805.153689] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.153880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.153995] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.154314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.154589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.155301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.155301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.155301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.155301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.155503] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.658657] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.658841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.658914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.659173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.678999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.679289] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.679510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.679510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.679690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.680030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.680030] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 is going to be updated. [ 805.703190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.703321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.703389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.703604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.703735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.714022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 in Status: IN_PROGRESS for 2s [ 805.780787] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 in Status: SUCCESS [ 805.780988] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 deletion is rescheduled due to dependency. [ 805.781154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.821037] env[70287]: INFO networking_nsxv3.common.synchronization [req-de287ac0-2883-4b83-8529-e25cf0feca58 req-e319174e-d17d-4181-9eaf-9de0ba342def tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 805.822389] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 805.822389] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.822389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.822389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.822389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.822634] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.822634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.822718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.824847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.824847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.824847] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.229460] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.229787] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.229787] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.230070] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.230339] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.230500] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.230618] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.230837] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.230983] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.231577] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.231704] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.231820] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.231986] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.232131] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 806.232242] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.232382] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.256734] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.256941] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 806.257185] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.257405] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.257810] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-a5abf2c4-47da-4e22-b4ef-918a62daf067 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.258032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.258170] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.258654] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.258707] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5abf2c4-47da-4e22-b4ef-918a62daf067',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.327192] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.327192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.327192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.327192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.350011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.350288] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.350426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.350496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.350701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.350786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.350891] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 806.377232] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.377380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.377435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.377651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.377786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.385609] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 806.505864] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 806.507233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.507652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.507989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.508434] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.508744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.510019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.510019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.765266] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.765476] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.766270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.766270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.766270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.766459] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port a5abf2c4-47da-4e22-b4ef-918a62daf067 not found, creating... [ 806.766686] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.766846] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.766967] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.767203] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.767348] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.767621] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.767773] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.767890] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.768126] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.768239] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.768380] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: a5abf2c4-47da-4e22-b4ef-918a62daf067 is going to be created. [ 806.788195] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.788421] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.788549] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.788822] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.789071] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.789393] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.012793] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.012994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.013083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.013291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.013711] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.013711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.013954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.014029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.014160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.014269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.014436] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.014547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.014606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.014757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.014925] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.015089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.015159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.015318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.015396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.015481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.015580] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.517953] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aafb90fc-938c-44be-9296-60863884f367: rpc.has_security_group_logging(os_id): False [ 807.536111] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.536111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.536111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.536111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.536111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.536111] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.536111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.536111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.536752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.536752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.536752] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.536752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.536752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.536914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.536914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.537951] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.538114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.539375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.539375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.539375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.539375] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 807.600804] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.600804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.600804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.600804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.600804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.616832] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 807.676361] env[70287]: INFO networking_nsxv3.common.synchronization [req-de287ac0-2883-4b83-8529-e25cf0feca58 req-95d7f9de-241c-4c3d-a725-9fd239233eb3 service nova] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_rules [ 807.677352] env[70287]: INFO networking_nsxv3.common.synchronization [req-de287ac0-2883-4b83-8529-e25cf0feca58 req-95d7f9de-241c-4c3d-a725-9fd239233eb3 service nova] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 807.681288] env[70287]: INFO networking_nsxv3.common.synchronization [req-de287ac0-2883-4b83-8529-e25cf0feca58 req-95d7f9de-241c-4c3d-a725-9fd239233eb3 service nova] Enqueued Resource ID: a5abf2c4-47da-4e22-b4ef-918a62daf067 with Priority: HIGHEST for action port [ 807.681877] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_rules [ 807.682109] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 807.682292] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5abf2c4-47da-4e22-b4ef-918a62daf067 with Priority: HIGHEST for action port [ 807.682633] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.682759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.682843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.683252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.683252] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.684129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.684232] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.684456] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5abf2c4-47da-4e22-b4ef-918a62daf067 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.684569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.684649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.684864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.684948] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5abf2c4-47da-4e22-b4ef-918a62daf067',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.724955] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 in Status: SUCCESS [ 807.725188] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 deletion is rescheduled due to dependency. [ 807.725303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.890222] env[70287]: INFO networking_nsxv3.common.synchronization [req-fd8024ae-3ee1-451d-939b-01f03baf399e req-1715e0f3-d28f-4ee7-a03f-027ff4655864 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 807.890852] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 807.891191] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.891384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.891384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.891586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.891740] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.891876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.891933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.892111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.892193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.892285] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.187439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.187641] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.188980] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5abf2c4-47da-4e22-b4ef-918a62daf067 with status ACTIVE [ 808.189170] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.189286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.189349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.189549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.189640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.189807] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.189923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.190010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.190186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.190186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.190386] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.190449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.190490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.190619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.190695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.190778] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5abf2c4-47da-4e22-b4ef-918a62daf067 is going to be updated. [ 808.216393] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.216558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.216625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.216828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.216964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.217142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5abf2c4-47da-4e22-b4ef-918a62daf067" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.394556] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.395891] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 808.396072] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 deletion is rescheduled due to dependency. [ 808.396187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.396369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.396807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.396877] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.397035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.397156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.397317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.397460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.397573] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.899351] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.903251] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.403441] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.403441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.403441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.403441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.403441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.403441] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 809.406034] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.427340] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.427488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.427565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.427756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.427896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.435770] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 809.629535] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 809.629867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.909092] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.910032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.910032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.910032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.910032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.910456] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 809.937585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.937863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.937957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.938265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.938452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.947288] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 810.709109] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-214f9d52-bfc0-4951-89fa-ab3441c1bf4f tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 810.709350] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 810.709847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.709847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.709847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.710677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.710677] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.710677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.710677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.710677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.710677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.710677] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.096164] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-386 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.096458] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.096500] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.096768] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.101146] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.101405] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.101533] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.101792] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.101995] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.102243] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.102362] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 811.102478] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 811.102588] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 811.102726] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 811.102842] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 811.103049] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 811.123149] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 811.123337] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 811.123477] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 811.123724] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.124124] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-3afd368b-b9ec-4736-b073-6642aa3b76a5 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.126922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.126922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.126922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.126922] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3afd368b-b9ec-4736-b073-6642aa3b76a5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.214571] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.214571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.214571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.214571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.245347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.245622] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.245747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.245810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.246076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.246195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.246364] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 811.271546] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.271764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.271890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.272220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.272914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.283978] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 811.446649] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 811.446920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.630650] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.630893] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.631038] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.631573] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.631778] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.631946] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 3afd368b-b9ec-4736-b073-6642aa3b76a5 not found, creating... [ 811.632245] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.632543] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.632709] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.632975] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.637028] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.637028] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.637028] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.637028] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.637028] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.637028] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.637028] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 3afd368b-b9ec-4736-b073-6642aa3b76a5 is going to be created. [ 811.654570] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.654798] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.654928] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.655248] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.655479] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.655708] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.958863] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 811.959110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.959287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.959514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.959705] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.959823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.959880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.960049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.960133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.960216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.960309] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.463326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.463647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.463647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.463781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.463942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.464098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.464159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.464315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.464401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.464488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.464636] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.464729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.464831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.464923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.465072] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.465162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.465213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.465350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.465424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.465502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.465598] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.496262] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-072277f2-e16b-4f5d-a656-97227a0cc681 service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 812.496480] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-072277f2-e16b-4f5d-a656-97227a0cc681 service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 812.496581] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-072277f2-e16b-4f5d-a656-97227a0cc681 service nova] Enqueued Resource ID: 3afd368b-b9ec-4736-b073-6642aa3b76a5 with Priority: HIGHEST for action port [ 812.496810] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 812.496933] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 812.497072] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3afd368b-b9ec-4736-b073-6642aa3b76a5 with Priority: HIGHEST for action port [ 812.497694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.497790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.497790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.497982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.501463] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.503027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.503135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.503336] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-3afd368b-b9ec-4736-b073-6642aa3b76a5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.503440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.503504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.503692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.503768] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3afd368b-b9ec-4736-b073-6642aa3b76a5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.622085] env[70287]: INFO networking_nsxv3.common.synchronization [None req-fa0c6510-71ea-4dc8-a8e8-ce528c5b4342 tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_rules [ 812.622652] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_rules [ 812.623016] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.623113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.623169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.623422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.623499] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.728976] env[70287]: INFO networking_nsxv3.common.synchronization [None req-4d769cec-b444-4c22-94e5-62d498dd6ce2 tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_rules [ 812.728976] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_rules [ 812.730188] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.730188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.970495] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c8498fc-c714-4100-81f9-c85ac268aab7: rpc.has_security_group_logging(os_id): False [ 812.987345] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.987629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.987750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.988095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.988808] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.989038] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.989150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.989218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.989395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.989469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.989670] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.989765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.989907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.989970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.990463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.990787] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.990919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.991030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.991255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.991422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.991690] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 813.004632] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.004824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.007793] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3afd368b-b9ec-4736-b073-6642aa3b76a5 with status ACTIVE [ 813.007793] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.007793] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.007793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.008457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.008457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.008457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.008457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.008457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.008457] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3afd368b-b9ec-4736-b073-6642aa3b76a5 is going to be updated. [ 813.026674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.026674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.026674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.026674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.026674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.026674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3afd368b-b9ec-4736-b073-6642aa3b76a5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.056997] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.056997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.056997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.056997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.056997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.068324] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 813.154948] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.155165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.155265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.155427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.155499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.155601] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 already deleted. [ 813.155710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.155869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.156303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.156303] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.297433] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 813.297433] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 deletion is rescheduled due to dependency. [ 813.297433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.297433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.297433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.297433] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.297832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.297832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.297832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.297938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.298065] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.677422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.677708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.677708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.677899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.677997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.678125] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 already deleted. [ 813.678210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.800778] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.303395] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.806054] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.806374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.806374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.806530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.806564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.806754] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 814.831828] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.832022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.832142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.832364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.832534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.840976] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 815.083012] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 815.083012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.852564] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 816.852564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.852963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.852963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.853253] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.853350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.853388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.853573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.853616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.853697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.853795] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.913029] env[70287]: INFO networking_nsxv3.common.synchronization [req-cef7f54b-7135-487e-9293-e5a7289a27b7 req-8f66c18b-749c-4bb5-b21a-f1bd4693de19 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_members [ 816.913029] env[70287]: INFO networking_nsxv3.common.synchronization [req-cef7f54b-7135-487e-9293-e5a7289a27b7 req-8f66c18b-749c-4bb5-b21a-f1bd4693de19 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 816.913295] env[70287]: INFO networking_nsxv3.common.synchronization [req-cef7f54b-7135-487e-9293-e5a7289a27b7 req-8f66c18b-749c-4bb5-b21a-f1bd4693de19 tempest-SecurityGroupsTestJSON-603580516 tempest-SecurityGroupsTestJSON-603580516-project-member] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 816.913688] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGHEST for action security_group_members [ 816.913825] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGHEST for action security_group_members [ 816.913924] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGHEST for action security_group_members [ 816.914658] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.915132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.915300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.915555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.915764] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.915987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.916183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.916562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.916778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.917428] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.919891] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.920104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.920291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.920647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.920856] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.921081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.921181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.921466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.921939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.922176] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.923430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.924167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.924349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.924751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.924869] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.925044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.925167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.926180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.926180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.926180] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.355679] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.355841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.355917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.356174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.356371] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.356504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.356572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.356729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.356817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.356910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.357073] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.357168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.357228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.357369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.357504] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.357594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.357652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.357784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.357859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.357953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.358048] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.428227] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.428449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.428562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.429225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.429225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.429225] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.429225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.429459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.429459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.429508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.429582] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be updated. [ 817.430748] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.430904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.430904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.431189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.431279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.431450] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.431544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.431604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.431745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.431818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.431906] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4de514c-a329-428e-aef2-824011ac27e1 is going to be updated. [ 817.432927] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.433037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.436439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.436439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.436439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.436439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.436439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.436439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.436439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.436439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.436439] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be updated. [ 817.465099] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.465099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.465099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.465099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.465099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.466631] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.466811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.466811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.466982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.467099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.468511] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.468621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.468941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.468941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.468941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.476936] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: IN_PROGRESS for 2s [ 817.477483] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: IN_PROGRESS for 2s [ 817.478117] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: IN_PROGRESS for 2s [ 817.867187] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d87c2dce-8258-430c-b549-6c6bfe5f0943: rpc.has_security_group_logging(os_id): False [ 817.880477] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-65e70d56-7c34-496a-86b6-24fd3388af0d tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 817.883034] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 817.884556] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.885175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.885287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.885605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.885857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.886248] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.887142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.887255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.887455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.887574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.887807] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.888593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.888697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.888895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.889020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.889264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.889415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.889497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.889663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.889822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.889963] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 817.891568] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.891707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.891798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.891995] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.892190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.892329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.892415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.892586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.892690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.892807] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.951605] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.951882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.951932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.952254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.952425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.964861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 818.266036] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-386 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.266036] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.266036] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.266036] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.266277] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.266932] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.266932] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.266932] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.266932] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.267135] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.267898] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.267898] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.267898] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.267898] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 818.267898] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.267898] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.286555] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.286724] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 818.286863] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.287147] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-386" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.287529] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-848b2355-9ea9-432d-8769-939386b0a9cf taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.287719] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.287843] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.288166] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.288314] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('848b2355-9ea9-432d-8769-939386b0a9cf',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.396175] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.792052] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.792052] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.792052] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.792052] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.792052] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.792052] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 848b2355-9ea9-432d-8769-939386b0a9cf not found, creating... [ 818.792052] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.792052] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.792398] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.792398] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.792617] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.792961] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.793180] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.793364] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.793632] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.793806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.793982] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 848b2355-9ea9-432d-8769-939386b0a9cf is going to be created. [ 818.811948] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.813269] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.813269] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.813269] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.813269] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.813269] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.897344] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.176235] env[70287]: INFO networking_nsxv3.common.synchronization [req-146a7625-4a46-4059-811d-5137bbff148c req-0c4a1d84-11d7-4abf-aaea-7eb096702687 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 819.176829] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 819.177195] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.177322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.177385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.177594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.177746] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.177999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.177999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.178701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.178833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.178992] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.399437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.399631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.399704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.400009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.400119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.400247] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 819.426436] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.426581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.426638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.426854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.427050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.435561] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 819.488528] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68e57bed-6bad-4f87-86dc-05486c964c31 in Status: SUCCESS [ 819.488787] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 deletion is rescheduled due to dependency. [ 819.488945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.489743] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4de514c-a329-428e-aef2-824011ac27e1 in Status: SUCCESS [ 819.489892] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4de514c-a329-428e-aef2-824011ac27e1 deletion is rescheduled due to dependency. [ 819.489990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.490617] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33f97a48-67cf-4681-a4ae-50c22c693573 in Status: SUCCESS [ 819.490759] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 deletion is rescheduled due to dependency. [ 819.490855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.533434] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-0c3ff213-618a-42cf-9873-2cbd6777345f service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 819.533720] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-0c3ff213-618a-42cf-9873-2cbd6777345f service nova] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 819.533934] env[70287]: INFO networking_nsxv3.common.synchronization [req-0a998ee5-693c-4431-b71b-8481a13dc854 req-0c3ff213-618a-42cf-9873-2cbd6777345f service nova] Enqueued Resource ID: 848b2355-9ea9-432d-8769-939386b0a9cf with Priority: HIGHEST for action port [ 819.534557] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_rules [ 819.534748] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 819.534872] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 848b2355-9ea9-432d-8769-939386b0a9cf with Priority: HIGHEST for action port [ 819.535415] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.535549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.537088] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.537229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.537443] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-848b2355-9ea9-432d-8769-939386b0a9cf taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.537554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.537621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.537822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.537904] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('848b2355-9ea9-432d-8769-939386b0a9cf',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.685587] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.685587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.685803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.685879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.685972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.686234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.686323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.686323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.686478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.686553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.686639] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 819.715507] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.715507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.715629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.715984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.716236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.725865] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 819.979291] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 819.979548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.979696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.979908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.979999] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.039355] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 848b2355-9ea9-432d-8769-939386b0a9cf with status ACTIVE [ 820.039592] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.039729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.039800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.039995] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.040117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.040288] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.040387] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.040445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.040592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.040665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.040839] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.040936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.040981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.041137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.041211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.041294] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 848b2355-9ea9-432d-8769-939386b0a9cf is going to be updated. [ 820.060591] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.060755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.060755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.060903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.061054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.061214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-848b2355-9ea9-432d-8769-939386b0a9cf" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.482733] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.482858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.504810] env[70287]: INFO networking_nsxv3.common.synchronization [req-837a6630-fc5e-44ef-8c9a-c725fcb6a6ae req-2c7d0c17-3069-4a05-a240-cbe974cc3581 tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 820.505552] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 820.505788] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.505908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.505973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.506252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.506429] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.506538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.506740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.506790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.506846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.506927] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.011305] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.011305] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.011305] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 already deleted. [ 821.011305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.018531] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.019038] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.019363] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.019873] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.020500] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.021054] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.021354] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.021778] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.022124] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.022656] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.022966] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.023366] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.023653] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.023944] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 821.024282] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.024596] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.044833] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.045042] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 821.045162] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.045362] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.045672] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-e24adb4d-9559-47ac-8a5e-d2d27540ba75 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.045856] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.045979] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.046320] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.046473] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e24adb4d-9559-47ac-8a5e-d2d27540ba75',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.446219] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 821.446219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.446219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.446363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.446604] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.446758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.446843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.447043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.447158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.447275] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.549065] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.549283] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.549417] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.549693] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.549844] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.550011] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port e24adb4d-9559-47ac-8a5e-d2d27540ba75 not found, creating... [ 821.551047] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.551047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.551047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.551047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.551047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.551262] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.552032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.552032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.552032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.552032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.552032] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 is going to be created. [ 821.572311] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.572311] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.572311] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.572311] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.572311] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.572311] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.736616] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 821.736929] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 821.736929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.949862] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.453413] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.492304] env[70287]: INFO networking_nsxv3.common.synchronization [req-837a6630-fc5e-44ef-8c9a-c725fcb6a6ae req-83f32cfa-b9db-4615-ad84-f0ceaf87ee96 service nova] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 822.492304] env[70287]: INFO networking_nsxv3.common.synchronization [req-837a6630-fc5e-44ef-8c9a-c725fcb6a6ae req-83f32cfa-b9db-4615-ad84-f0ceaf87ee96 service nova] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 822.492304] env[70287]: INFO networking_nsxv3.common.synchronization [req-837a6630-fc5e-44ef-8c9a-c725fcb6a6ae req-83f32cfa-b9db-4615-ad84-f0ceaf87ee96 service nova] Enqueued Resource ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 with Priority: HIGHEST for action port [ 822.492304] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 822.492304] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 822.492804] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 with Priority: HIGHEST for action port [ 822.493362] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.493712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.494320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.494725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.495721] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.496184] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.496406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.496491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.496757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.497161] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.497231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.497313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.497605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.497770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.498015] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.499206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e24adb4d-9559-47ac-8a5e-d2d27540ba75 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.499427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.499551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.500013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.500013] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e24adb4d-9559-47ac-8a5e-d2d27540ba75',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.957885] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.957885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.957885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.957885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.957885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.957885] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 822.985711] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.986222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.986222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.986222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.986405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.997022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 823.002459] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e24adb4d-9559-47ac-8a5e-d2d27540ba75 with status ACTIVE [ 823.002701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.002836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.002906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.003137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.003226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.003405] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.003576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.003576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.003704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.003777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.003956] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.004063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.004116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.004260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.004334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.004418] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 is going to be updated. [ 823.005600] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.006517] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.006617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.027852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.028055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.028162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.028714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.028714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.028714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.508417] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.013156] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.013341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.013427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.013651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.013741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.013842] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 is going to be created. [ 824.039939] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.040105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.040170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.040376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.040527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.054772] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: UNINITIALIZED for 2s [ 825.006276] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 825.006547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.006749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.007016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.007246] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.007387] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.007472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.007645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.007728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.007818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.007910] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.510679] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.510845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.510913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.511161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.511348] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.511417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.511480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.511622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.511710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.511815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.512014] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.512094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.512144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.512338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.512429] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.512599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.512694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.512810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.512884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.512963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.513079] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.015431] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d87c2dce-8258-430c-b549-6c6bfe5f0943: rpc.has_security_group_logging(os_id): False [ 826.034472] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.034629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.034670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.035402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.035402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.035402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.035402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.035402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.035622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.035622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.035803] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.035893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.035954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.036110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.036198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.036437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.036545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.036581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.036720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.036793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.036879] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 826.062791] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: SUCCESS [ 826.063046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.063216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.063429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.063616] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.063732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.063793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.063936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.064026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.064178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.064241] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.116599] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.116745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.116816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.117037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.117182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.133574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 826.565976] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.068180] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae697c95-678e-4288-aec7-3a6fe1dee306: rpc.has_security_group_logging(os_id): False [ 827.086853] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.087049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.087202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.087413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.087550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.088089] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.088089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.088461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.088461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.088461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.088550] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 is going to be created. [ 827.143745] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.143929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.143929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.144216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.144522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.154825] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: IN_PROGRESS for 2s [ 827.494049] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 827.494711] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 828.079026] env[70287]: INFO networking_nsxv3.common.synchronization [req-68ef30de-ae5d-4379-bcd8-7e0679022c0e req-18c3e987-6bc1-40f1-9675-448dc418d9aa tempest-ServerDiagnosticsTest-1341694827 tempest-ServerDiagnosticsTest-1341694827-project-member] Enqueued Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_members [ 828.079026] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_members [ 828.079026] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b6a470-77b3-4223-87b5-475c69bf4519 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.079419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.079419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.079751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.080661] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.080805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.080904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.081145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.081280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.081399] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.156807] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 828.156807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.468021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.468349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.468567] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.468920] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.469444] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.469620] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.469783] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.470035] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.470247] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.470512] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.470691] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.470897] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.471061] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.471231] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 828.471370] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.471531] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.489217] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.489480] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 828.489690] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.489943] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-868" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.490433] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-bc58914f-b593-4923-a521-3d0e52d8e9fe taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.490697] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.490882] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.492044] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.492044] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc58914f-b593-4923-a521-3d0e52d8e9fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.584540] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.584763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.584849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.585331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.585365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.585565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.585685] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.585767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.585949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.586043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.586140] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b6a470-77b3-4223-87b5-475c69bf4519 already deleted. [ 828.586271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.791281] env[70287]: INFO networking_nsxv3.common.synchronization [req-0143abf9-281b-4f04-91f8-b8c988d3afb0 req-8c894e60-4985-4ff7-bfc3-0fb1b61c4c52 tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 828.791792] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 828.792223] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.792298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.792338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.793320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.793320] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.793320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.793320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.793320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.794385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.794521] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.996021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.996021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port bc58914f-b593-4923-a521-3d0e52d8e9fe not found, creating... [ 828.996021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.996021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.996408] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.997103] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.997422] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.997762] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.999828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.999828] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: bc58914f-b593-4923-a521-3d0e52d8e9fe is going to be created. [ 829.017909] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.018329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.018329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.019025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.019025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.019025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.163131] env[70287]: INFO networking_nsxv3.common.synchronization [req-77d5d2cc-3559-4787-9cf2-4a0861d52002 req-85b30f6b-1330-49c2-938e-1738b9b319e3 tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 829.163681] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 829.164108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.164266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.164340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.168021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.168021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.168021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.168021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.168021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.168021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.168021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.169429] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: SUCCESS [ 829.169527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.185845] env[70287]: INFO networking_nsxv3.common.synchronization [req-87ed31ac-d114-4dcc-9b87-25b2a1ffe2b3 req-839220cb-b144-4d58-8b0c-ac25f87e3a23 tempest-MultipleCreateTestJSON-983032647 tempest-MultipleCreateTestJSON-983032647-project-member] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 829.186529] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGHEST for action security_group_members [ 829.186649] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.186750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.298039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.298276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.298396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.298725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.299233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.299306] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.299419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.299520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.299760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.299880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.300073] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 829.328039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.328039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.328039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.328353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.328419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.336136] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 829.671534] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.671534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.671534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.671703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.671735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.671944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.672062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.672659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.672659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.672659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.672659] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 829.698347] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.698437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.698496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.698695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.698829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.706844] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 829.821894] env[70287]: INFO networking_nsxv3.common.synchronization [req-68ef30de-ae5d-4379-bcd8-7e0679022c0e req-32788de5-3683-4b4f-bf1c-fa20942acf37 service nova] Enqueued Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_rules [ 829.822071] env[70287]: INFO networking_nsxv3.common.synchronization [req-68ef30de-ae5d-4379-bcd8-7e0679022c0e req-32788de5-3683-4b4f-bf1c-fa20942acf37 service nova] Enqueued Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_members [ 829.822220] env[70287]: INFO networking_nsxv3.common.synchronization [req-68ef30de-ae5d-4379-bcd8-7e0679022c0e req-32788de5-3683-4b4f-bf1c-fa20942acf37 service nova] Enqueued Resource ID: bc58914f-b593-4923-a521-3d0e52d8e9fe with Priority: HIGHEST for action port [ 829.822456] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_rules [ 829.822583] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_members [ 829.822676] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc58914f-b593-4923-a521-3d0e52d8e9fe with Priority: HIGHEST for action port [ 829.823242] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-35b6a470-77b3-4223-87b5-475c69bf4519 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.823439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.823439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.823684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.823827] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.825013] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b6a470-77b3-4223-87b5-475c69bf4519 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.825013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.825013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.825013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.825556] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.825556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.825556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.825556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.825556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.825883] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.826618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc58914f-b593-4923-a521-3d0e52d8e9fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.827045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.827045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.827045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.827045] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc58914f-b593-4923-a521-3d0e52d8e9fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.328779] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b6a470-77b3-4223-87b5-475c69bf4519 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.328779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.333029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc58914f-b593-4923-a521-3d0e52d8e9fe with status ACTIVE [ 830.333029] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.333029] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.333029] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.333029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.333029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc58914f-b593-4923-a521-3d0e52d8e9fe is going to be updated. [ 830.333907] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.354925] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.354925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.354925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.354925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.354925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.354925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc58914f-b593-4923-a521-3d0e52d8e9fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.837418] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.338993] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.339329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.339329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.339490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.339518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.339639] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b6a470-77b3-4223-87b5-475c69bf4519 is going to be created. [ 831.367649] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 831.367832] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 deletion is rescheduled due to dependency. [ 831.367951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.372028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.372028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.372028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.372028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.372028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.380571] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b6a470-77b3-4223-87b5-475c69bf4519 in Status: UNINITIALIZED for 2s [ 831.717375] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 831.717375] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 deletion is rescheduled due to dependency. [ 831.717375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.717375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.717375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.717375] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.717680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.717680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.717821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.717905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.718032] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.221385] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.221575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.221668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.224019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.224211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.224474] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.224595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.224660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.224850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.224945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.230017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be updated. [ 832.272303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.272493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.272562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.272713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.272848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.284850] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: IN_PROGRESS for 2s [ 833.112656] env[70287]: INFO networking_nsxv3.common.synchronization [req-02935759-4d37-4ed9-9ee1-a9ec9c264e05 req-b3e24a00-588c-43e0-93ff-9ee2c7082aa4 tempest-InstanceActionsTestJSON-225466912 tempest-InstanceActionsTestJSON-225466912-project-member] Enqueued Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_members [ 833.113203] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_members [ 833.113507] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.113631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.113697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.113938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.117703] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.117703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.117703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.117703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.117703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.117703] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.391503] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b6a470-77b3-4223-87b5-475c69bf4519 in Status: SUCCESS [ 833.391722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.392305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.392504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.392837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.392837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.392993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.393053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.393094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.393186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.393274] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.517629] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-801 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.517815] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-801" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.517967] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-801" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.518459] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-801" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.518584] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.518746] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.518863] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.519140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.519380] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.519635] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.519757] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 833.519867] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 833.519977] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 833.520099] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 833.520207] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 833.520338] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 833.537696] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 833.537744] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 833.537865] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 833.538072] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-801" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.538433] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-eb27a7e9-eae0-492a-8754-275b72a587b2 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.538531] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.538658] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.538962] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.539113] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb27a7e9-eae0-492a-8754-275b72a587b2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.618304] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.618304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.618304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.618304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.618304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.618786] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.618786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.618786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.618786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.618786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.618935] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 already deleted. [ 833.618935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.901205] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b6a470-77b3-4223-87b5-475c69bf4519 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.901389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.901487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.901676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.901844] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.901944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.902016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.902165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.902251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.902374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.902503] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b6a470-77b3-4223-87b5-475c69bf4519 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.902558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.902620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.902809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.902887] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.902978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.903051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.903191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.903355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.903355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.903465] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.042420] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.042690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.042824] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.043233] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.043310] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.043463] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port eb27a7e9-eae0-492a-8754-275b72a587b2 not found, creating... [ 834.043841] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.044018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.044138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.044433] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.044585] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.044874] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.045039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.045839] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.045839] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.045839] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.045996] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: eb27a7e9-eae0-492a-8754-275b72a587b2 is going to be created. [ 834.065774] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.066074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.066254] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.066671] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.069050] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.069050] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.297034] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 in Status: SUCCESS [ 834.297292] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 deletion is rescheduled due to dependency. [ 834.297292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.405524] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 35b6a470-77b3-4223-87b5-475c69bf4519: rpc.has_security_group_logging(os_id): False [ 834.423267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.423396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.423484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.423676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.423764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.423988] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.424102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.424161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.424346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.424431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.424614] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.424718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.424766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.424898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.424969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.425161] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.425280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.425356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.425460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.425533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.425620] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 35b6a470-77b3-4223-87b5-475c69bf4519 is going to be created. [ 834.476904] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.477097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.477151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.477367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.477560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.487665] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b6a470-77b3-4223-87b5-475c69bf4519 in Status: IN_PROGRESS for 2s [ 835.018466] env[70287]: INFO networking_nsxv3.common.synchronization [None req-df657699-cbc0-4412-877e-3079e246f9f8 None None] Enqueued Resource ID: e725f633-2f1e-421c-b5a1-5d64aed2b22f with Priority: HIGHEST for action port [ 835.023018] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e725f633-2f1e-421c-b5a1-5d64aed2b22f with Priority: HIGHEST for action port [ 835.023018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e725f633-2f1e-421c-b5a1-5d64aed2b22f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.023018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e725f633-2f1e-421c-b5a1-5d64aed2b22f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.023018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e725f633-2f1e-421c-b5a1-5d64aed2b22f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.023018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e725f633-2f1e-421c-b5a1-5d64aed2b22f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.023018] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e725f633-2f1e-421c-b5a1-5d64aed2b22f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.261246] env[70287]: INFO networking_nsxv3.common.synchronization [req-0dbf0ef9-434a-4482-bf80-229125361d12 req-626c824b-1c0c-4ffa-a308-1b26b6af97e4 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 835.261785] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 835.262213] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.262270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.262304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.262494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.262673] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.262780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.262844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.262991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.263650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.263777] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.290677] env[70287]: INFO networking_nsxv3.common.synchronization [req-02935759-4d37-4ed9-9ee1-a9ec9c264e05 req-469e1ea1-3418-4296-8a4c-907cc71a9597 service nova] Enqueued Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_rules [ 835.290856] env[70287]: INFO networking_nsxv3.common.synchronization [req-02935759-4d37-4ed9-9ee1-a9ec9c264e05 req-469e1ea1-3418-4296-8a4c-907cc71a9597 service nova] Enqueued Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_members [ 835.290995] env[70287]: INFO networking_nsxv3.common.synchronization [req-02935759-4d37-4ed9-9ee1-a9ec9c264e05 req-469e1ea1-3418-4296-8a4c-907cc71a9597 service nova] Enqueued Resource ID: eb27a7e9-eae0-492a-8754-275b72a587b2 with Priority: HIGHEST for action port [ 835.291487] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_rules [ 835.291621] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_members [ 835.292009] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb27a7e9-eae0-492a-8754-275b72a587b2 with Priority: HIGHEST for action port [ 835.293292] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.293425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.293494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.293807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.293889] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.295136] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.295257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.295309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.295464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.295625] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.296463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.296463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.296463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.296463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.296463] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.297404] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb27a7e9-eae0-492a-8754-275b72a587b2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.297404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.297697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.297697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.297697] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb27a7e9-eae0-492a-8754-275b72a587b2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.523424] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e725f633-2f1e-421c-b5a1-5d64aed2b22f [ 835.523556] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.523738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.523788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.523954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.525069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.525069] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e725f633-2f1e-421c-b5a1-5d64aed2b22f already deleted. [ 835.525069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e725f633-2f1e-421c-b5a1-5d64aed2b22f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.548959] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.549114] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.549251] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.549532] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.550029] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.550029] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.551411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.551411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.551411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.551497] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.551549] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 835.551659] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 835.551771] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 835.551951] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 835.551996] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 835.552297] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 835.570611] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 835.570902] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 835.571104] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 835.571317] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.571732] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-03117628-6408-4953-9457-4f27c8c5d8fe taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.571919] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.572056] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.572518] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.572675] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03117628-6408-4953-9457-4f27c8c5d8fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.767692] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.767861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.767934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.768204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.793009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.793299] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.794265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.794265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.794265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.794265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.794265] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 835.803261] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.803261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.803261] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.804395] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb27a7e9-eae0-492a-8754-275b72a587b2 with status ACTIVE [ 835.804585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.804702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.804765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.804963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.805076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.805459] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.805561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.805634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.805809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.805890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.806204] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.806313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.806377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.806600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.810021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.810021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb27a7e9-eae0-492a-8754-275b72a587b2 is going to be updated. [ 835.834345] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.834497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.834535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.834737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.834869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.835040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb27a7e9-eae0-492a-8754-275b72a587b2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.836237] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.836350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.836421] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.836772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.836772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.848879] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 836.075548] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.075694] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.075815] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.076347] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.076347] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.076662] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 03117628-6408-4953-9457-4f27c8c5d8fe not found, creating... [ 836.076880] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.077279] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.077279] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.077418] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.077570] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.077885] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.078073] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.078205] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.078444] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.078603] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.078754] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 03117628-6408-4953-9457-4f27c8c5d8fe is going to be created. [ 836.099406] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.099705] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.099970] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.100375] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.100618] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.100939] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.310471] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.500580] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 35b6a470-77b3-4223-87b5-475c69bf4519 in Status: SUCCESS [ 836.500809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.814229] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.814381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.814381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.814917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.814917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.814917] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 is going to be created. [ 836.820618] env[70287]: INFO networking_nsxv3.common.synchronization [req-0dbf0ef9-434a-4482-bf80-229125361d12 req-7bbd6912-907c-4749-9aa2-ca55b64126bb service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 836.820861] env[70287]: INFO networking_nsxv3.common.synchronization [req-0dbf0ef9-434a-4482-bf80-229125361d12 req-7bbd6912-907c-4749-9aa2-ca55b64126bb service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 836.820861] env[70287]: INFO networking_nsxv3.common.synchronization [req-0dbf0ef9-434a-4482-bf80-229125361d12 req-7bbd6912-907c-4749-9aa2-ca55b64126bb service nova] Enqueued Resource ID: 03117628-6408-4953-9457-4f27c8c5d8fe with Priority: HIGHEST for action port [ 836.821463] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 836.821631] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 836.821724] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03117628-6408-4953-9457-4f27c8c5d8fe with Priority: HIGHEST for action port [ 836.827739] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.827904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.827963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.828151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.828225] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.829543] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.829660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.829830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-03117628-6408-4953-9457-4f27c8c5d8fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.829924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.829987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.830169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.830246] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03117628-6408-4953-9457-4f27c8c5d8fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.844570] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.844773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.844773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.844944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.845112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.853816] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 in Status: UNINITIALIZED for 2s [ 836.920149] env[70287]: INFO networking_nsxv3.common.synchronization [None req-2d3314a4-fff7-41bf-95ac-453e081c5959 None None] Enqueued Resource ID: 1ff670e2-a800-4405-a734-5f7472c6d252 with Priority: HIGHEST for action port [ 836.920346] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ff670e2-a800-4405-a734-5f7472c6d252 with Priority: HIGHEST for action port [ 836.920962] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1ff670e2-a800-4405-a734-5f7472c6d252 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.921127] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1ff670e2-a800-4405-a734-5f7472c6d252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.921236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1ff670e2-a800-4405-a734-5f7472c6d252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.922203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1ff670e2-a800-4405-a734-5f7472c6d252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.922381] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1ff670e2-a800-4405-a734-5f7472c6d252',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.092114] env[70287]: INFO networking_nsxv3.common.synchronization [None req-15677ba6-53e4-4fa7-b7c9-0c5a838b3af8 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 837.092578] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 837.092954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.093139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.093217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.093461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.093545] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.182804] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ddbd6e92-9c33-447c-a895-3dd5ba0f3c9e tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 837.183606] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 837.183874] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.183968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.332873] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.333295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.333295] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03117628-6408-4953-9457-4f27c8c5d8fe with status ACTIVE [ 837.334121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.334121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.334121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.334121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.334121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.334121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.334452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.334452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.334452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.334561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.335445] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.335445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.335445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.335445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.335445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.335445] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03117628-6408-4953-9457-4f27c8c5d8fe is going to be updated. [ 837.358027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.358027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.358027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.358027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.358027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.358287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03117628-6408-4953-9457-4f27c8c5d8fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.425373] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1ff670e2-a800-4405-a734-5f7472c6d252 [ 837.425373] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.425562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.425562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.427467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.427467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.427467] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1ff670e2-a800-4405-a734-5f7472c6d252 already deleted. [ 837.427467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1ff670e2-a800-4405-a734-5f7472c6d252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.613326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.613326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.613326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.613326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.613326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.613326] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 already deleted. [ 837.613545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.613945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.614133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.614312] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.859281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 837.859467] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d deletion is rescheduled due to dependency. [ 837.859582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.859738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.859960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.860157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.860275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.860339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.860487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.860567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.860662] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.140220] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.140220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.140220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.140220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.140220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.140220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 already deleted. [ 838.140220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.362945] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.521300] env[70287]: INFO networking_nsxv3.common.synchronization [req-6d173e04-47f6-4e21-ba48-af62798c929d req-6e0dcef0-4c54-4d4b-b0bc-78f97321fc67 tempest-ServerActionsV293TestJSON-1180885877 tempest-ServerActionsV293TestJSON-1180885877-project-member] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_members [ 838.521793] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGHEST for action security_group_members [ 838.522099] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.522225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.522289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.522614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.522680] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.522737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.522800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.522943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.523040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.523132] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.865382] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 in Status: SUCCESS [ 838.865628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.865909] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.866908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.867153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.867500] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.867651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.867718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.867898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.868054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.868118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.868172] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.026041] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.026313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.026313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.026560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.026621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.026799] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.026923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.026994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.027137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.027215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.027313] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc is going to be updated. [ 839.053350] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.053612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.053612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.053886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.054068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.062904] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: IN_PROGRESS for 2s [ 839.370094] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.370456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.370456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.370584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.370726] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.370835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.371605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.371605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.371605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.371605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.371605] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.371605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.371605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.371838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.371927] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.372097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.372212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.372408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.372504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.372605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.372737] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.374403] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.374514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.374682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.374749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.375636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.375636] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 839.408673] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.408862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.408907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.409115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.409254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.419276] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 839.875537] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea613e25-cc1d-4b11-9ac5-2be1d0651607: rpc.has_security_group_logging(os_id): False [ 839.893131] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.893303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.893393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.893608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.893720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.893941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.894067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.894150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.894359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.894453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.894682] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.894783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.894861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.895045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.895124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.895331] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.895436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.895498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.895652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.895725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.895812] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 is going to be created. [ 839.951395] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.951544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.951642] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.951867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.952057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.965492] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 in Status: IN_PROGRESS for 2s [ 841.089440] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc in Status: SUCCESS [ 841.089763] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc deletion is rescheduled due to dependency. [ 841.089812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.430152] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 841.430364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.430895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.431147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.431339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.431457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.431527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.431719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.431808] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.431894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.431985] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.938699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.938699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.938699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.938699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.938699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.939302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.939302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.939302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.939302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.939719] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.980651] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 in Status: SUCCESS [ 841.980651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.019730] env[70287]: INFO networking_nsxv3.common.synchronization [None req-84fa1337-7edd-4c38-a974-e2ce7e226c68 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 842.020248] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 842.020612] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.020749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.020818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.021432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.021744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.021867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.021931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.022123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.022231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.022417] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.441922] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d: rpc.has_security_group_logging(os_id): False [ 842.459885] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.460049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.460124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.460331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.460425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.460619] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.460716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.460776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.460921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.460996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.461194] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.461288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.461626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.461626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.461626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.461773] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.461854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.461913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.462060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.462179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.462292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 842.525324] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.530090] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.530090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.530090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.530090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.530090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.540364] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 842.727744] env[70287]: INFO networking_nsxv3.common.synchronization [req-bbbefe76-f0fb-43f4-bf8b-076d4278a733 req-5d7c83b9-9e1d-482a-840d-07384f2e408a tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_members [ 842.728317] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_members [ 842.728626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-306ade67-3f30-492d-a51d-d4eb542da01d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.728747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.728814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.732501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.732687] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.732798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.732865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.733060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.733149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.733244] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.027880] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.027880] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.027880] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.027880] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.027880] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.028756] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.033022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.033022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.033022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.033022] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.033022] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 843.033022] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 843.033022] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 843.033022] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 843.033022] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 843.033022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 843.033022] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.053026] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 843.053026] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 843.053026] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 843.053026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-242" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.053026] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.053026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.053026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.053026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.053026] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51dbdae3-f88c-45d2-b76d-a1ac9e354f92',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.240071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.240071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.240071] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 306ade67-3f30-492d-a51d-d4eb542da01d already deleted. [ 843.240071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.535744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.536123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.536123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.536251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.536302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.536397] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 843.555829] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.556397] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.556397] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.556551] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.556605] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.556754] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 51dbdae3-f88c-45d2-b76d-a1ac9e354f92 not found, creating... [ 843.557031] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.557192] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.557313] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.557595] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.557682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.557942] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.558110] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.558230] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.558436] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.558577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.558923] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 51dbdae3-f88c-45d2-b76d-a1ac9e354f92 is going to be created. [ 843.595189] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.595312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.595367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.595854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.595854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.600631] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.602102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.602102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.602102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.602102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.602102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.609253] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 844.546694] env[70287]: INFO networking_nsxv3.common.synchronization [req-bbbefe76-f0fb-43f4-bf8b-076d4278a733 req-b7d6d604-aff0-4d07-8efb-316034b2c343 service nova] Enqueued Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_rules [ 844.547403] env[70287]: INFO networking_nsxv3.common.synchronization [req-bbbefe76-f0fb-43f4-bf8b-076d4278a733 req-b7d6d604-aff0-4d07-8efb-316034b2c343 service nova] Enqueued Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_members [ 844.547403] env[70287]: INFO networking_nsxv3.common.synchronization [req-bbbefe76-f0fb-43f4-bf8b-076d4278a733 req-b7d6d604-aff0-4d07-8efb-316034b2c343 service nova] Enqueued Resource ID: 51dbdae3-f88c-45d2-b76d-a1ac9e354f92 with Priority: HIGHEST for action port [ 844.548045] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_rules [ 844.548290] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_members [ 844.548404] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51dbdae3-f88c-45d2-b76d-a1ac9e354f92 with Priority: HIGHEST for action port [ 844.551892] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-306ade67-3f30-492d-a51d-d4eb542da01d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.552135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.552135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.552873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.552873] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.553388] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-306ade67-3f30-492d-a51d-d4eb542da01d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.553474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.553526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.553700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.553970] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.553970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.554100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.554129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.554343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.554343] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.557124] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.557124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.557124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.557124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.557124] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51dbdae3-f88c-45d2-b76d-a1ac9e354f92',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.560998] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 844.561234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.854896] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.855115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.855243] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.855527] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.855783] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.855938] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.857637] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.857892] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.858167] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.858785] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.858785] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.858785] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.858785] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.859218] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 844.859218] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.859218] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.865161] env[70287]: INFO networking_nsxv3.common.synchronization [req-9f6deffd-6173-496c-944d-701b6a6905fa req-df4bb8e5-186e-46d9-8d05-66c2386928c8 tempest-ServerDiagnosticsTest-1341694827 tempest-ServerDiagnosticsTest-1341694827-project-member] Enqueued Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_members [ 844.865578] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35b6a470-77b3-4223-87b5-475c69bf4519 with Priority: HIGHEST for action security_group_members [ 844.867841] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-35b6a470-77b3-4223-87b5-475c69bf4519 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.867841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.867841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.867841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.867841] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.867841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.867841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.867841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.867841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.867841] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('35b6a470-77b3-4223-87b5-475c69bf4519',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.877675] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.877675] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 844.877675] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.877675] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.877675] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-1d07307e-b832-4522-8e6f-c944e21b8d3a taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.877675] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.878358] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.878358] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.878358] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d07307e-b832-4522-8e6f-c944e21b8d3a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.059832] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-306ade67-3f30-492d-a51d-d4eb542da01d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.059832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.060024] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.061064] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51dbdae3-f88c-45d2-b76d-a1ac9e354f92 with status ACTIVE [ 845.065023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.065023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.065023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.065023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.065023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51dbdae3-f88c-45d2-b76d-a1ac9e354f92 is going to be updated. [ 845.086143] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.086386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.086386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.086710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.087068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.087269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51dbdae3-f88c-45d2-b76d-a1ac9e354f92" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.370371] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.370531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.370612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.370801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.370887] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.371096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.371192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.371257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.371648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.371648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.371648] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b6a470-77b3-4223-87b5-475c69bf4519 is going to be updated. [ 845.381914] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.382332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.382518] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.382856] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.385032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.385032] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 1d07307e-b832-4522-8e6f-c944e21b8d3a not found, creating... [ 845.385032] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.385032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.385032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.385032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.385032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.385032] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.385032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.385032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.388151] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.388151] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.388151] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 1d07307e-b832-4522-8e6f-c944e21b8d3a is going to be created. [ 845.390058] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f7eb5bd-706e-4175-ae9f-09253c5e98f6 req-582331fc-67b4-4467-badd-1a6f62ad06af tempest-ServersWithSpecificFlavorTestJSON-185056864 tempest-ServersWithSpecificFlavorTestJSON-185056864-project-member] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 845.391250] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 845.391469] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.391586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.391653] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.394097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.394097] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.394097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.394097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.394097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.394097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.394097] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.418404] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.418404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.418404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.418404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.418404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.418404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.422050] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.422416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.422588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.422855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.423237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.431854] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b6a470-77b3-4223-87b5-475c69bf4519 in Status: IN_PROGRESS for 2s [ 845.567663] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.628007] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 845.628240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.898281] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.898449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.898523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.898975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.924906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.924906] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.924906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.924906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.925092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.925903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.925903] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 is going to be updated. [ 845.949305] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.949305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.949305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.949488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.949627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.959047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: IN_PROGRESS for 2s [ 846.069568] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.070308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.070308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.070308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.070308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.070481] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 306ade67-3f30-492d-a51d-d4eb542da01d is going to be created. [ 846.095648] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.095860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.095860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.096389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.096389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.112022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 306ade67-3f30-492d-a51d-d4eb542da01d in Status: UNINITIALIZED for 2s [ 846.156524] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-139 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.156741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.156872] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.157168] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.157433] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.157593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.157784] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.157930] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.158084] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.158298] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.158415] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 846.158553] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 846.158681] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 846.158800] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 846.158915] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 846.159059] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 846.186331] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 846.186828] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 846.186828] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 846.186828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-139" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.187149] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-59d008f1-faf6-4730-b059-db21b3e6672c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.187328] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.187453] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.187783] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.187928] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d008f1-faf6-4730-b059-db21b3e6672c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.522077] env[70287]: INFO networking_nsxv3.common.synchronization [req-2c7dc841-5c3d-46b4-9b85-0b9c99ebe3bc req-c70f9f42-2476-4531-a3b7-87bb9bf166a1 service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 846.522077] env[70287]: INFO networking_nsxv3.common.synchronization [req-2c7dc841-5c3d-46b4-9b85-0b9c99ebe3bc req-c70f9f42-2476-4531-a3b7-87bb9bf166a1 service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 846.522077] env[70287]: INFO networking_nsxv3.common.synchronization [req-2c7dc841-5c3d-46b4-9b85-0b9c99ebe3bc req-c70f9f42-2476-4531-a3b7-87bb9bf166a1 service nova] Enqueued Resource ID: 1d07307e-b832-4522-8e6f-c944e21b8d3a with Priority: HIGHEST for action port [ 846.522077] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 846.522077] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 846.522077] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d07307e-b832-4522-8e6f-c944e21b8d3a with Priority: HIGHEST for action port [ 846.522830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.524057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.524264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.524587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.527017] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.527017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.527017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.527017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.527017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.527017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.527017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.527017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.527017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.527017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.529098] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.529632] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d07307e-b832-4522-8e6f-c944e21b8d3a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.529741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.529799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.529952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.530103] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d07307e-b832-4522-8e6f-c944e21b8d3a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.691343] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.691800] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.691800] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.692054] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.692215] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.692424] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 59d008f1-faf6-4730-b059-db21b3e6672c not found, creating... [ 846.692700] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.692865] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.692988] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.693231] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.693375] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.693699] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.693871] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.693994] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.694468] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.694651] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.694809] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 59d008f1-faf6-4730-b059-db21b3e6672c is going to be created. [ 846.715488] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.715741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.715819] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.716125] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.716364] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.716609] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.032464] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.032621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.032836] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d07307e-b832-4522-8e6f-c944e21b8d3a with status ACTIVE [ 847.033020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.033129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.033194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.035664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.035824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.036179] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.036310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.036377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.037725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.037725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.037725] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.037725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.037725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.037725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.037978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.037978] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d07307e-b832-4522-8e6f-c944e21b8d3a is going to be updated. [ 847.041474] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.060571] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.060708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.060776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.060972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.061128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.061286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d07307e-b832-4522-8e6f-c944e21b8d3a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.442958] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 35b6a470-77b3-4223-87b5-475c69bf4519 in Status: SUCCESS [ 847.444028] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 35b6a470-77b3-4223-87b5-475c69bf4519 deletion is rescheduled due to dependency. [ 847.444028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-35b6a470-77b3-4223-87b5-475c69bf4519" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.512833] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f7eb5bd-706e-4175-ae9f-09253c5e98f6 req-04946e92-1828-4417-acdf-1992ecb43f29 service nova] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 847.513020] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f7eb5bd-706e-4175-ae9f-09253c5e98f6 req-04946e92-1828-4417-acdf-1992ecb43f29 service nova] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 847.513168] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f7eb5bd-706e-4175-ae9f-09253c5e98f6 req-04946e92-1828-4417-acdf-1992ecb43f29 service nova] Enqueued Resource ID: 59d008f1-faf6-4730-b059-db21b3e6672c with Priority: HIGHEST for action port [ 847.513395] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_rules [ 847.513517] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 847.513611] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59d008f1-faf6-4730-b059-db21b3e6672c with Priority: HIGHEST for action port [ 847.514443] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.514826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.514826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.514826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.514982] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.516261] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.516261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.516432] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-59d008f1-faf6-4730-b059-db21b3e6672c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.516748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.516748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.516748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.516953] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59d008f1-faf6-4730-b059-db21b3e6672c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.542293] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.687750] env[70287]: INFO networking_nsxv3.common.synchronization [None req-933d9632-2299-4cdd-ac27-5ce80bb8f66a None None] Enqueued Resource ID: a7b4c147-355b-4d7a-a208-5ee2a5201ffd with Priority: HIGHEST for action port [ 847.688250] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7b4c147-355b-4d7a-a208-5ee2a5201ffd with Priority: HIGHEST for action port [ 847.688860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7b4c147-355b-4d7a-a208-5ee2a5201ffd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.688860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7b4c147-355b-4d7a-a208-5ee2a5201ffd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.688860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7b4c147-355b-4d7a-a208-5ee2a5201ffd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.692243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7b4c147-355b-4d7a-a208-5ee2a5201ffd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.692542] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7b4c147-355b-4d7a-a208-5ee2a5201ffd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.972864] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: SUCCESS [ 847.973055] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 deletion is rescheduled due to dependency. [ 847.973166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.973386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.973623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.973824] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.973939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.973996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.974228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.974275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.974377] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.025023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59d008f1-faf6-4730-b059-db21b3e6672c with status ACTIVE [ 848.025023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.025023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.025023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.025023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.025023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59d008f1-faf6-4730-b059-db21b3e6672c is going to be updated. [ 848.027925] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.028141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.044640] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.044850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.045215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.046014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.046199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.046348] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 848.055232] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.055232] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.055536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.056261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.056347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.056515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59d008f1-faf6-4730-b059-db21b3e6672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.079706] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.079706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.079706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.080776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.080776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.089317] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 848.117282] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 306ade67-3f30-492d-a51d-d4eb542da01d in Status: UNINITIALIZED for 4s [ 848.174147] env[70287]: INFO networking_nsxv3.common.synchronization [req-72c50025-469d-4509-ad69-bb171ba3b156 req-99e7f66a-c3b2-481a-8aa8-2ff3f96ec94f tempest-InstanceActionsV221TestJSON-1154730883 tempest-InstanceActionsV221TestJSON-1154730883-project-member] Enqueued Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_members [ 848.177402] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_members [ 848.177734] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.177860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.177928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.178207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.179238] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.179238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.179238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.179238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.179238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.179238] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.197835] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7b4c147-355b-4d7a-a208-5ee2a5201ffd [ 848.197996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.198148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.198214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.198448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.198550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.198649] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7b4c147-355b-4d7a-a208-5ee2a5201ffd already deleted. [ 848.198732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7b4c147-355b-4d7a-a208-5ee2a5201ffd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.477347] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.685941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.685941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.685941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.685941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.685941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.686205] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.686324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.686394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.686576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.686759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.686759] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae already deleted. [ 848.686896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.981026] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.132882] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-14 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.133105] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-14" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.133296] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-14" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.133603] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-14" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.137023] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.137463] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.137620] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.137922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.138099] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.138365] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.138486] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.138600] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.138713] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.138827] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 849.138936] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.139090] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.162025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.162025] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 849.162025] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.162025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-14" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.162025] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-89becc93-c9f1-4777-9683-5b4e75b91eb5 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.162025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.162025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.162025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.162524] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89becc93-c9f1-4777-9683-5b4e75b91eb5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.485149] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.485149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.485149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.485149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.485630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.485630] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 is going to be updated. [ 849.514027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.514181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.514252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.514668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.514668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.523433] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: IN_PROGRESS for 2s [ 849.667133] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.667133] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.667133] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.667133] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.667133] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.667413] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 89becc93-c9f1-4777-9683-5b4e75b91eb5 not found, creating... [ 849.667543] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.667709] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.667875] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.668156] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.668384] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.668705] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.668869] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.668983] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.669771] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.669965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.670514] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 89becc93-c9f1-4777-9683-5b4e75b91eb5 is going to be created. [ 849.704625] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.705181] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.705410] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.705786] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.706680] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.706680] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.720269] env[70287]: INFO networking_nsxv3.common.synchronization [None req-3d08fa87-f300-4109-ba24-120d809497c0 None None] Enqueued Resource ID: 738b45a0-6aec-43ae-aced-110bed5dfae5 with Priority: HIGHEST for action port [ 849.720269] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738b45a0-6aec-43ae-aced-110bed5dfae5 with Priority: HIGHEST for action port [ 849.720900] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-738b45a0-6aec-43ae-aced-110bed5dfae5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.721142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-738b45a0-6aec-43ae-aced-110bed5dfae5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.721598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-738b45a0-6aec-43ae-aced-110bed5dfae5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.721598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-738b45a0-6aec-43ae-aced-110bed5dfae5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.721598] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('738b45a0-6aec-43ae-aced-110bed5dfae5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.100844] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 850.101183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.101349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.101546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.101829] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.101960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.101960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.102151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.102291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.102448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.102576] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.129059] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 306ade67-3f30-492d-a51d-d4eb542da01d in Status: SUCCESS [ 850.129291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.129796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.130334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.130334] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.130334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.130767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.130767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.130767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.130767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.130940] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.223312] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 738b45a0-6aec-43ae-aced-110bed5dfae5 [ 850.223453] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.223581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.223647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.225461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.226625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.226789] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:738b45a0-6aec-43ae-aced-110bed5dfae5 already deleted. [ 850.226895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-738b45a0-6aec-43ae-aced-110bed5dfae5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.604963] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.605156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.605218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.605440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.605654] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.605910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.605992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.606172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.606258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.606360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.606504] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.606610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.606694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.606813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.606951] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.607052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.607410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.607580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.607649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.608160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.608160] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.634755] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.835214] env[70287]: INFO networking_nsxv3.common.synchronization [req-72c50025-469d-4509-ad69-bb171ba3b156 req-5fbfccef-46d5-4c62-8fd6-c925d49904bb service nova] Enqueued Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_rules [ 850.835214] env[70287]: INFO networking_nsxv3.common.synchronization [req-72c50025-469d-4509-ad69-bb171ba3b156 req-5fbfccef-46d5-4c62-8fd6-c925d49904bb service nova] Enqueued Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_members [ 850.835214] env[70287]: INFO networking_nsxv3.common.synchronization [req-72c50025-469d-4509-ad69-bb171ba3b156 req-5fbfccef-46d5-4c62-8fd6-c925d49904bb service nova] Enqueued Resource ID: 89becc93-c9f1-4777-9683-5b4e75b91eb5 with Priority: HIGHEST for action port [ 850.836010] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_rules [ 850.836010] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_members [ 850.842244] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89becc93-c9f1-4777-9683-5b4e75b91eb5 with Priority: HIGHEST for action port [ 850.843154] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.843154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.843154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.843402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.843814] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.845427] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.849420] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.849420] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.849420] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-89becc93-c9f1-4777-9683-5b4e75b91eb5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.849420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.849420] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89becc93-c9f1-4777-9683-5b4e75b91eb5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.986457] env[70287]: INFO networking_nsxv3.common.synchronization [req-ebafd784-61ca-42b1-a44d-11bad3abbc04 req-a65f6167-9e93-499d-9e55-e9cb6b247696 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 850.988330] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 850.994998] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.994998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.994998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.994998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.994998] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.994998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.994998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.994998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.994998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.994998] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.113373] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d: rpc.has_security_group_logging(os_id): False [ 851.138424] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 306ade67-3f30-492d-a51d-d4eb542da01d: rpc.has_security_group_logging(os_id): False [ 851.158017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.158017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.158017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.158017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.158541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.158541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.158541] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.158541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.158541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.158674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.158774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.158895] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 851.164500] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.164500] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.164500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.164500] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 306ade67-3f30-492d-a51d-d4eb542da01d is going to be created. [ 851.262676] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.262842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.262903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.263140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.263318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.265739] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.265891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.265986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.266200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.266391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.281118] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 306ade67-3f30-492d-a51d-d4eb542da01d in Status: IN_PROGRESS for 2s [ 851.290355] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 851.352851] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.353939] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.354474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.358354] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89becc93-c9f1-4777-9683-5b4e75b91eb5 with status ACTIVE [ 851.359311] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.359415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.359579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.360288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.360394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.360589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.360695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.360760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.360919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.361014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.361200] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.361295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.361364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.361587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.361716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.361824] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89becc93-c9f1-4777-9683-5b4e75b91eb5 is going to be updated. [ 851.405815] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.406024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.406252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.406419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.406562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.406731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89becc93-c9f1-4777-9683-5b4e75b91eb5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.497150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.497402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.497507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.498277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.498277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.498277] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.498277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.498277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.499141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.499313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.500059] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f already deleted. [ 851.500059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.535696] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: SUCCESS [ 851.536066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.536823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.536823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.537446] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.537446] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.537446] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.537446] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.537446] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.537652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.537652] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.700852] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.701395] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.702398] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.703134] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.703679] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.703897] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.704141] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.704505] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.704712] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.704996] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.705172] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.705338] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.705504] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.705667] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 851.705821] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.706021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.724662] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.724907] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 851.725080] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.725326] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.725757] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-10f0e828-800c-4767-a8ee-60a1266107fb taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.725989] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.726451] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.726584] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.726788] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10f0e828-800c-4767-a8ee-60a1266107fb',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.837409] env[70287]: INFO networking_nsxv3.common.synchronization [req-d58f0ae0-6069-4ddf-9025-97d51ce31003 req-92e3bbca-4203-4172-bd10-76bfdfea082e tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 851.837409] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 851.837409] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.837409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.837409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.838024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.838297] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.839263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.839335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.839512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.839601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.839695] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.858039] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.898201] env[70287]: INFO networking_nsxv3.common.synchronization [req-d58f0ae0-6069-4ddf-9025-97d51ce31003 req-92e3bbca-4203-4172-bd10-76bfdfea082e tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 851.898201] env[70287]: INFO networking_nsxv3.common.synchronization [req-d58f0ae0-6069-4ddf-9025-97d51ce31003 req-92e3bbca-4203-4172-bd10-76bfdfea082e tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 851.898201] env[70287]: INFO networking_nsxv3.common.synchronization [req-d58f0ae0-6069-4ddf-9025-97d51ce31003 req-92e3bbca-4203-4172-bd10-76bfdfea082e tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: dad11f87-7224-42d2-95d3-6caec8021731 with Priority: HIGHEST for action port [ 851.899361] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 851.899361] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 851.899361] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad11f87-7224-42d2-95d3-6caec8021731 with Priority: HIGHEST for action port [ 851.899361] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.899361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.900561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.900942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.900942] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.902035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.902245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.903259] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-dad11f87-7224-42d2-95d3-6caec8021731 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.903259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.903259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.903259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.903259] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dad11f87-7224-42d2-95d3-6caec8021731',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.044151] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.232633] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.232949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.232990] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.233573] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.233573] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.233573] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 10f0e828-800c-4767-a8ee-60a1266107fb not found, creating... [ 852.234014] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.234123] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.234268] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.234647] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.234647] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.235115] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.237176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.237320] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.237582] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.237674] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.237837] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 10f0e828-800c-4767-a8ee-60a1266107fb is going to be created. [ 852.265173] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.265416] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.265549] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.265827] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.266076] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.266861] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.346779] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.359982] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.360326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.360326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.360549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.360678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.360789] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae is going to be created. [ 852.398235] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.398379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.398450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.398662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.398839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.404942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.405033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.405175] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dad11f87-7224-42d2-95d3-6caec8021731 with status ACTIVE [ 852.406082] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.406082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.406082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.406082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.406082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.406082] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.406354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.406354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.406354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.406469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.407160] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.407160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.407160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.407160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.407442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.407442] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dad11f87-7224-42d2-95d3-6caec8021731 is going to be updated. [ 852.419923] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae in Status: UNINITIALIZED for 2s [ 852.431524] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.431524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.431524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.431524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.431524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.431524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.551496] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac98ad7d-21c7-4c9e-add9-9d7467bf4897: rpc.has_security_group_logging(os_id): False [ 852.580323] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.580473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.580540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.580748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.580836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.581096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.581193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.581252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.581403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.581476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.581558] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 is going to be updated. [ 852.662094] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.662182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.662182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.662433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.662573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.673803] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: IN_PROGRESS for 2s [ 852.850224] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.295025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 306ade67-3f30-492d-a51d-d4eb542da01d in Status: SUCCESS [ 853.295025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.306879] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 853.307194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.353242] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.353474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.353542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.353748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.353876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.353985] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 853.383304] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.383528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.383528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.383909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.384084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.394213] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 853.743155] env[70287]: INFO networking_nsxv3.common.synchronization [req-ebafd784-61ca-42b1-a44d-11bad3abbc04 req-f6c9a4fe-59c7-4282-bfda-fdb5cec608e6 service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 853.744346] env[70287]: INFO networking_nsxv3.common.synchronization [req-ebafd784-61ca-42b1-a44d-11bad3abbc04 req-f6c9a4fe-59c7-4282-bfda-fdb5cec608e6 service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 853.744789] env[70287]: INFO networking_nsxv3.common.synchronization [req-ebafd784-61ca-42b1-a44d-11bad3abbc04 req-f6c9a4fe-59c7-4282-bfda-fdb5cec608e6 service nova] Enqueued Resource ID: 10f0e828-800c-4767-a8ee-60a1266107fb with Priority: HIGHEST for action port [ 853.745350] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 853.745505] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 853.749674] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10f0e828-800c-4767-a8ee-60a1266107fb with Priority: HIGHEST for action port [ 853.749674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.749674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.749674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.749674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.749674] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.749940] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.749940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.749940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.750108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.750249] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.750337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.750403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.750542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.750631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.750702] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.751434] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-10f0e828-800c-4767-a8ee-60a1266107fb taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.751537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.751601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.751743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.751811] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('10f0e828-800c-4767-a8ee-60a1266107fb',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.254642] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.254780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.254964] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 10f0e828-800c-4767-a8ee-60a1266107fb with status ACTIVE [ 854.255157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.255259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.255319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.255544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.255675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.255859] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.255959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.256031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.256189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.256264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.256443] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.256535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.256594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.256754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.256845] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.256931] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 10f0e828-800c-4767-a8ee-60a1266107fb is going to be updated. [ 854.258986] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.285677] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.285677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.285677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.285677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.285677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.285677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-10f0e828-800c-4767-a8ee-60a1266107fb" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.432021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae in Status: SUCCESS [ 854.432293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.432392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.433072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.433072] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.433072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.433072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.433290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.433290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.433290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.433364] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.687300] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: SUCCESS [ 854.687771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.762114] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.940245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.940245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.940245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.940245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.940245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.940752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.940752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.940752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.940752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.940752] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.110042] env[70287]: INFO networking_nsxv3.common.synchronization [req-676787cc-2b76-4ca7-a47c-9ea200006140 req-290ed367-9baf-460d-a841-ca592440c523 tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 855.110544] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 855.114024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.114024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.114024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.114024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.114024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.114024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.114024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.114024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.114024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.114024] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.267335] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.267539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.267539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.267722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.267820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.267919] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be created. [ 855.300060] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.300413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.300519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.301386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.301386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.314175] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: UNINITIALIZED for 2s [ 855.409978] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 855.411866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.412124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.412543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.413242] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.413242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.413242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.413242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.413242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.413558] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.445156] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a986e1a5-6b8e-4d48-9768-decfdf0f10ae: rpc.has_security_group_logging(os_id): False [ 855.465451] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.465754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.467121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.467121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.467121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.467977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.468167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.468259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.468489] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.468564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.470065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.470065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.470065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.470065] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae is going to be created. [ 855.544734] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.544914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.544946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.545177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.545896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.558400] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae in Status: IN_PROGRESS for 2s [ 855.618142] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.917014] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.120518] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.255117] env[70287]: INFO networking_nsxv3.common.synchronization [req-b75c975e-7554-499a-86e9-7ab288610a18 req-ed48cd17-0b24-4258-99b6-8de55bbfcc5f tempest-InstanceActionsTestJSON-225466912 tempest-InstanceActionsTestJSON-225466912-project-member] Enqueued Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_members [ 856.255117] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGHEST for action security_group_members [ 856.255117] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.255117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.255768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.256176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.256608] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.257104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.257289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.257901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.258106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.258401] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.351290] env[70287]: INFO networking_nsxv3.common.synchronization [None req-6ce0adce-29fd-4cd2-9c6d-e3c7077b4db8 None None] Enqueued Resource ID: df8e15e3-847c-4be6-8271-fcda5a5a61de with Priority: HIGHEST for action port [ 856.353019] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df8e15e3-847c-4be6-8271-fcda5a5a61de with Priority: HIGHEST for action port [ 856.353019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-df8e15e3-847c-4be6-8271-fcda5a5a61de taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.353019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df8e15e3-847c-4be6-8271-fcda5a5a61de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.353019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df8e15e3-847c-4be6-8271-fcda5a5a61de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.353019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df8e15e3-847c-4be6-8271-fcda5a5a61de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.353019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df8e15e3-847c-4be6-8271-fcda5a5a61de',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.420476] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.625983] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.625983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.625983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.626510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.626510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.626510] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 856.654663] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.654663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.654663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.654864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.654922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.665663] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 856.761698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.761863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.761934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.762205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.762293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.762538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.762643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.762703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.762890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.762947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.763020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 is going to be updated. [ 856.792943] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.792943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.792943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.792943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.792943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.802338] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 in Status: IN_PROGRESS for 2s [ 856.857112] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df8e15e3-847c-4be6-8271-fcda5a5a61de [ 856.857493] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.857735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.857862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.858227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.858811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.858811] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df8e15e3-847c-4be6-8271-fcda5a5a61de already deleted. [ 856.858811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df8e15e3-847c-4be6-8271-fcda5a5a61de" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.923027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.923027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.923027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.923027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.923027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.923027] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 856.951907] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.955472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.955472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.955472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.955472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.966642] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 857.277407] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.277681] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.277855] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.278304] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.278645] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.278829] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.278964] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.279285] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.279488] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.279768] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.279941] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 857.280105] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 857.280265] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 857.280400] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 857.280572] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 857.280799] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 857.305215] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 857.305473] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 857.305645] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 857.305920] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.306174] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-5152593a-378e-42a4-a791-cbc51db5dbcc taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.306352] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.306475] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.306802] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.306947] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5152593a-378e-42a4-a791-cbc51db5dbcc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.326429] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 857.326660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.327078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.327294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.327479] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.327599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.327667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.327922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.327922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.328048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.328359] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.575447] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae in Status: SUCCESS [ 857.575447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.727150] env[70287]: INFO networking_nsxv3.common.synchronization [None req-bf406d92-bd1f-48e8-8374-e56e0e60b130 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_rules [ 857.727694] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_rules [ 857.728863] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.728991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.729071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.729336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.729419] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.810757] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.811105] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.811160] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.811439] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.811604] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.811773] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 5152593a-378e-42a4-a791-cbc51db5dbcc not found, creating... [ 857.812087] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.812248] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.812367] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.812626] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.812774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.813080] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.813236] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.813353] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.813561] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.813695] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.813836] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 5152593a-378e-42a4-a791-cbc51db5dbcc is going to be created. [ 857.831290] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.834919] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.835200] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.835353] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.835672] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.836247] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.836538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.190478] env[70287]: INFO networking_nsxv3.common.synchronization [None req-d35f4599-f6d3-4054-84fa-c9688691d688 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_rules [ 858.191098] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_rules [ 858.191706] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.191856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.254018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.254267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.254389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.256450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.256450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.256450] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 already deleted. [ 858.256450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.256450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.256450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.256450] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.335942] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f: rpc.has_security_group_logging(os_id): False [ 858.356697] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.356924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.357025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.357274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.357396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.357674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.357812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.357893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.358087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.358189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.358292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be created. [ 858.421780] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.422272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.422373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.422614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.422828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.435198] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 858.531499] env[70287]: INFO networking_nsxv3.common.synchronization [req-796fd647-ac65-49da-8d6f-6e8604943c00 req-7a88483d-3943-4e55-be16-9e8bb7c4a425 tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 858.532072] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 858.533491] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.533491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.533491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.533491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.533491] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.536253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.536253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.536253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.536253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.536253] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.676172] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 858.676172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.779826] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.780351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.780746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.780746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.781109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.781415] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 already deleted. [ 858.781415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.789800] env[70287]: INFO networking_nsxv3.common.synchronization [req-4b2323b1-0c5c-432f-813c-09c8504316f0 req-8463b3fa-afb3-4751-9e5c-97c1201cff8f tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 858.790378] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 858.792157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.792289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.819613] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 in Status: SUCCESS [ 858.819613] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 deletion is rescheduled due to dependency. [ 858.819753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.842401] env[70287]: INFO networking_nsxv3.common.synchronization [req-4b2323b1-0c5c-432f-813c-09c8504316f0 req-8463b3fa-afb3-4751-9e5c-97c1201cff8f tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 858.842669] env[70287]: INFO networking_nsxv3.common.synchronization [req-4b2323b1-0c5c-432f-813c-09c8504316f0 req-8463b3fa-afb3-4751-9e5c-97c1201cff8f tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 858.842821] env[70287]: INFO networking_nsxv3.common.synchronization [req-4b2323b1-0c5c-432f-813c-09c8504316f0 req-8463b3fa-afb3-4751-9e5c-97c1201cff8f tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: dad11f87-7224-42d2-95d3-6caec8021731 with Priority: HIGHEST for action port [ 858.843755] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_rules [ 858.843755] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 858.843755] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dad11f87-7224-42d2-95d3-6caec8021731 with Priority: HIGHEST for action port [ 858.844032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.844170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.844413] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.844573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.844877] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-dad11f87-7224-42d2-95d3-6caec8021731 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.845589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.845589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.845589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.845589] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dad11f87-7224-42d2-95d3-6caec8021731',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.977200] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 858.979172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.979172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.979172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.979172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.980378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.980378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.980378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.980378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.980378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.980378] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.983266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.983466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.983708] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.984054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.984503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.985525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.985813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.986040] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.987742] env[70287]: INFO networking_nsxv3.common.synchronization [None req-54253ee6-296a-4cea-886b-76e092b33b4c None None] Enqueued Resource ID: fc744830-875b-417a-990d-35fd831da52a with Priority: HIGHEST for action port [ 858.989816] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc744830-875b-417a-990d-35fd831da52a with Priority: HIGHEST for action port [ 858.990778] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc744830-875b-417a-990d-35fd831da52a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.990880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc744830-875b-417a-990d-35fd831da52a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.991265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc744830-875b-417a-990d-35fd831da52a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.992035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc744830-875b-417a-990d-35fd831da52a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.992035] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc744830-875b-417a-990d-35fd831da52a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.038802] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.250155] env[70287]: INFO networking_nsxv3.common.synchronization [req-676787cc-2b76-4ca7-a47c-9ea200006140 req-ab263817-b505-476a-beae-ad2fe236e584 service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 859.250331] env[70287]: INFO networking_nsxv3.common.synchronization [req-676787cc-2b76-4ca7-a47c-9ea200006140 req-ab263817-b505-476a-beae-ad2fe236e584 service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 859.250472] env[70287]: INFO networking_nsxv3.common.synchronization [req-676787cc-2b76-4ca7-a47c-9ea200006140 req-ab263817-b505-476a-beae-ad2fe236e584 service nova] Enqueued Resource ID: 5152593a-378e-42a4-a791-cbc51db5dbcc with Priority: HIGHEST for action port [ 859.251121] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 859.251251] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 859.251321] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5152593a-378e-42a4-a791-cbc51db5dbcc with Priority: HIGHEST for action port [ 859.251650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.251745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.251784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.251990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.252097] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.252964] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.256776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.256776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.256898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.257734] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.257734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.257734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.257734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.257734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.257734] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.259973] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-5152593a-378e-42a4-a791-cbc51db5dbcc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.259973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.259973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.259973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.259973] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5152593a-378e-42a4-a791-cbc51db5dbcc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.322315] env[70287]: INFO networking_nsxv3.common.synchronization [None req-57722589-39ca-44aa-8244-8fdf9c16deaf None None] Enqueued Resource ID: f6e752a9-4711-4300-afcd-983433be194f with Priority: HIGHEST for action port [ 859.323207] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6e752a9-4711-4300-afcd-983433be194f with Priority: HIGHEST for action port [ 859.323297] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6e752a9-4711-4300-afcd-983433be194f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.323362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6e752a9-4711-4300-afcd-983433be194f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.323399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6e752a9-4711-4300-afcd-983433be194f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.323785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6e752a9-4711-4300-afcd-983433be194f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.323785] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6e752a9-4711-4300-afcd-983433be194f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.348430] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dad11f87-7224-42d2-95d3-6caec8021731 with status ACTIVE [ 859.348430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.348430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.348617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.348708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.348798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.348975] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.349096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.349159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.349313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.349391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.349583] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.349679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.349740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.349877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.349953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.350050] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dad11f87-7224-42d2-95d3-6caec8021731 is going to be updated. [ 859.374290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.374478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.374570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.374777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.374949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.375088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dad11f87-7224-42d2-95d3-6caec8021731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.377538] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-294 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.377721] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.377851] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.378122] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.378438] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.378915] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.379049] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.379270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.379409] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.379611] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.379722] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.379829] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.379935] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.380052] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 859.380158] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.380289] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.400542] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.400798] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 859.400947] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.401138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-294" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.401463] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-a8742f5d-bdc5-410c-adc5-6569e391bc9c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.401627] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.401742] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.402874] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.403826] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8742f5d-bdc5-410c-adc5-6569e391bc9c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.492895] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.493078] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.495585] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc744830-875b-417a-990d-35fd831da52a [ 859.495900] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.496103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.496203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.496503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.496639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.496789] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc744830-875b-417a-990d-35fd831da52a already deleted. [ 859.496909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc744830-875b-417a-990d-35fd831da52a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.541819] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.761674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.761674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.766600] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.766600] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5152593a-378e-42a4-a791-cbc51db5dbcc with status ACTIVE [ 859.766600] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.766600] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.766600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.766600] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.767301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.767301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.767301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.767301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.767301] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5152593a-378e-42a4-a791-cbc51db5dbcc is going to be updated. [ 859.790011] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.790359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.790359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.790494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.790568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.790728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5152593a-378e-42a4-a791-cbc51db5dbcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.828626] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6e752a9-4711-4300-afcd-983433be194f [ 859.828626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.828626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.828626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.828626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.828626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.828626] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6e752a9-4711-4300-afcd-983433be194f already deleted. [ 859.828626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6e752a9-4711-4300-afcd-983433be194f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.915389] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.915389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.915389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.915389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.915389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.915389] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port a8742f5d-bdc5-410c-adc5-6569e391bc9c not found, creating... [ 859.915859] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.915859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.915946] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.916210] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.916376] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.916766] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.916959] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.918918] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.919596] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.919596] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.919855] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: a8742f5d-bdc5-410c-adc5-6569e391bc9c is going to be created. [ 859.949689] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.949689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.949689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.949689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.949689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.949689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.996924] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.998016] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c4fea80-b8d6-423e-9f82-93c6ef731d08: rpc.has_security_group_logging(os_id): False [ 860.026733] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.026892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.026946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.027154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.027271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.027497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.027604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.027664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.027813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.027892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.031058] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 860.045532] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.045692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.045692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.046170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.046170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.046170] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 860.101595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.101698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.101698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.105021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.105021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.120756] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 860.141088] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.141088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.141088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.141088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.141088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.179866] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 860.269697] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.455101] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 860.456013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.499694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.499921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.500043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.500340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.500606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.500789] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 860.536974] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.537145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.537244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.537521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.537803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.548565] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 860.774173] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.774173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.774173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.774173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.774173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.774173] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 860.809512] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.809512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.809512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.809512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.809940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.821641] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 861.100317] env[70287]: INFO networking_nsxv3.common.synchronization [req-70022307-c259-4664-b7db-a4ad558e68d3 req-35ba1118-4d14-45f8-b775-99f1789e31d9 tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_members [ 861.100994] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_members [ 861.101899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.102264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.102510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.102869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.103191] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.103296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.103485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.103778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.103913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.104155] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.521885] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7c7c8bc8-dd35-46a4-8f01-6ced816cc398 None None] Enqueued Resource ID: 3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26 with Priority: HIGHEST for action port [ 861.523818] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26 with Priority: HIGHEST for action port [ 861.523818] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.524083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.524173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.524453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.526548] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.572633] env[70287]: INFO networking_nsxv3.common.synchronization [req-796fd647-ac65-49da-8d6f-6e8604943c00 req-ecb326dd-c72b-4238-b3d4-ceb6494840fb service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 861.572840] env[70287]: INFO networking_nsxv3.common.synchronization [req-796fd647-ac65-49da-8d6f-6e8604943c00 req-ecb326dd-c72b-4238-b3d4-ceb6494840fb service nova] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 861.572986] env[70287]: INFO networking_nsxv3.common.synchronization [req-796fd647-ac65-49da-8d6f-6e8604943c00 req-ecb326dd-c72b-4238-b3d4-ceb6494840fb service nova] Enqueued Resource ID: a8742f5d-bdc5-410c-adc5-6569e391bc9c with Priority: HIGHEST for action port [ 861.573505] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_rules [ 861.573636] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 861.573731] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a8742f5d-bdc5-410c-adc5-6569e391bc9c with Priority: HIGHEST for action port [ 861.577071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.577071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.577071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.577071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.577071] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.577071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.577368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.577368] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a8742f5d-bdc5-410c-adc5-6569e391bc9c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.577522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.577522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.577659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.577736] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a8742f5d-bdc5-410c-adc5-6569e391bc9c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.608603] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.608603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.608603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.609587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.609719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.610108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.610226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.610298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.610515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.610654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.610797] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 already deleted. [ 861.610913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.956110] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.956110] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.957858] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.958744] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.959037] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.960143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.960143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.960143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.961107] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.961200] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.961328] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.961963] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.961963] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.961963] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 861.961963] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.961963] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.981895] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.981895] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 861.981895] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.981895] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.981895] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-9167f074-d99c-4ac4-ba34-32bd4bff6410 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.982208] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.982266] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.982676] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.984599] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9167f074-d99c-4ac4-ba34-32bd4bff6410',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.033449] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26 [ 862.033449] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.033449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.033449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.033776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.033776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.033915] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26 already deleted. [ 862.034294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f63ca51-36a6-4db3-bcaf-1c9ad4dc3b26" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.080279] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.080415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.080565] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a8742f5d-bdc5-410c-adc5-6569e391bc9c with status ACTIVE [ 862.080696] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.080809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.081239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.081239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.081239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.081440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.081440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.083543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.083543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.083543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.083543] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.083543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.083543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.083543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.083543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.083543] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a8742f5d-bdc5-410c-adc5-6569e391bc9c is going to be updated. [ 862.104813] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.105304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.105304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.105512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.105755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.105969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a8742f5d-bdc5-410c-adc5-6569e391bc9c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.136178] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 862.136671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.137276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.137523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.137742] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.137896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.137959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.138635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.139067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.139320] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.199444] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 862.199690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.200262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.200524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.200627] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.487565] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.488901] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.489829] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.489829] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.489829] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.489829] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 9167f074-d99c-4ac4-ba34-32bd4bff6410 not found, creating... [ 862.489993] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.490233] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.490398] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.490632] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.490773] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.493403] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.493991] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.493991] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.494230] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.494418] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.494679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 9167f074-d99c-4ac4-ba34-32bd4bff6410 is going to be created. [ 862.518458] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.518458] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.518458] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.518458] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.518458] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.518458] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.559271] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 862.559271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.559271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.559496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.559977] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.559977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.559977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.560153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.560153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.560220] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.643836] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.707594] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.709378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.831176] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 862.831398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.831958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.832191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.832759] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.832759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.832759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.832759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.832759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.832986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.832986] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.064871] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.146368] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.301019] env[70287]: INFO networking_nsxv3.common.synchronization [req-b7253673-573b-458a-b4ed-07ccd1df6f01 req-f9b3ebc1-0a55-46d5-b952-95ee82283010 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 863.301019] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 863.301019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.301019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.301019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.301019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.301825] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.302105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.302412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.302700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.303479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.303479] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.336655] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.336806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.336892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.337119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.337310] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.337413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.337471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.337626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.337714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.337801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.337945] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.338050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.338117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.338259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.338400] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.338474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.338527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.338663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.338810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.338810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.338931] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.566833] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.616615] env[70287]: INFO networking_nsxv3.common.synchronization [req-c9ed733f-d77b-4a16-9ec0-4c4cc87a36d6 req-fd9a2ba1-de1e-4ae3-a177-651bf9e8384f tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 863.617388] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 863.617985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.617985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.617985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.618522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.618522] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.618691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.618691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.619861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.619861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.619861] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.649993] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.649993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.649993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.650172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.650172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.650276] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 863.716548] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.716548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.716548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.716548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.716548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.724568] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 863.806770] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.842631] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5344b0-d8f6-49cd-abc4-1a415b3aa399: rpc.has_security_group_logging(os_id): False [ 863.861821] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.861821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.861930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.862577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.862577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.862577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.862577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.862577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.862906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.862906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.862978] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.863075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.863134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.863273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.863349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.865646] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.866262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.866262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.866488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.866578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.866673] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 863.934079] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.934578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.934759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.935125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.936523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.958249] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 864.053639] env[70287]: INFO networking_nsxv3.common.synchronization [req-70022307-c259-4664-b7db-a4ad558e68d3 req-bdfda8d7-2841-408e-9a8c-9f737a43acc6 service nova] Enqueued Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_rules [ 864.053950] env[70287]: INFO networking_nsxv3.common.synchronization [req-70022307-c259-4664-b7db-a4ad558e68d3 req-bdfda8d7-2841-408e-9a8c-9f737a43acc6 service nova] Enqueued Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_members [ 864.054060] env[70287]: INFO networking_nsxv3.common.synchronization [req-70022307-c259-4664-b7db-a4ad558e68d3 req-bdfda8d7-2841-408e-9a8c-9f737a43acc6 service nova] Enqueued Resource ID: 9167f074-d99c-4ac4-ba34-32bd4bff6410 with Priority: HIGHEST for action port [ 864.054908] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_rules [ 864.054908] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_members [ 864.055032] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9167f074-d99c-4ac4-ba34-32bd4bff6410 with Priority: HIGHEST for action port [ 864.055597] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.055597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.055822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.055999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.056362] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.057956] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.057956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.058508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.058508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.058751] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.058828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.058904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.059113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.059228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.059357] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.060377] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9167f074-d99c-4ac4-ba34-32bd4bff6410 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.060706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.060706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.060923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.061058] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9167f074-d99c-4ac4-ba34-32bd4bff6410',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.070131] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.070131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.070131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.071727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.071727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.071727] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 864.123805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.123805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.123805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.123805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.123805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.123805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.123805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.124168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.124168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.124168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.124168] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be deleted. [ 864.133606] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.133739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.133807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.133996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.134145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.145228] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 864.195541] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.195541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.195541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.195541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.195541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.195541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.311421] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.547994] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.548213] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.548697] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.548998] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.549282] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.549448] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.549576] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.549798] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.549940] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.550159] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.550272] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.550380] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.550484] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.550591] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 864.550695] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.550826] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.563633] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.566019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.566019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9167f074-d99c-4ac4-ba34-32bd4bff6410 with status ACTIVE [ 864.566019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.566019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.566019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.566521] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.566521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.566521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.566521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.566521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.566668] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9167f074-d99c-4ac4-ba34-32bd4bff6410 is going to be updated. [ 864.572212] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.572212] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 864.572212] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.572212] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.572212] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-6c2c8849-9df1-4cdb-9c78-208de675f916 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.572212] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.572212] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.572483] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.572592] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c2c8849-9df1-4cdb-9c78-208de675f916',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.595430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.595635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.595745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.595940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.596110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.596274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9167f074-d99c-4ac4-ba34-32bd4bff6410" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.817027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.817027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.817027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.817027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.817027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.817027] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 864.853790] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.853790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.853790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.853790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.853790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.861740] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 865.069574] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.076900] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.077422] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.078477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.079131] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.079424] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.079794] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 6c2c8849-9df1-4cdb-9c78-208de675f916 not found, creating... [ 865.080276] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.080601] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.080887] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.081337] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.081661] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.082289] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.082806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.083019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.083362] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.083646] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.083935] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 6c2c8849-9df1-4cdb-9c78-208de675f916 is going to be created. [ 865.105118] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.107065] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.107065] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.107065] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.107065] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.107065] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.336637] env[70287]: INFO networking_nsxv3.common.synchronization [None req-dacd4d6e-bbb4-4d86-858c-4ddab769d4be tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 865.336637] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 865.338437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.338770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.451072] env[70287]: INFO networking_nsxv3.common.synchronization [req-56f06728-f348-48a9-b6f2-0424dbc22694 req-74e2c954-d100-47cd-909a-10dc93345cf4 tempest-AttachInterfacesUnderV243Test-1729306752 tempest-AttachInterfacesUnderV243Test-1729306752-project-member] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 865.451072] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGHEST for action security_group_members [ 865.451555] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.451898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.574819] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.578471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.578471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.578471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.578471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.578471] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 is going to be created. [ 865.611688] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.612114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.612367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.612682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.613022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.626881] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 in Status: UNINITIALIZED for 2s [ 865.735925] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 865.736198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.736370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.736596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.736792] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.736992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.737768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.737768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.737768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.737768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.737768] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.973912] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 865.974180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.156175] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.156175] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.156175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.156699] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.158245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.158245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.158245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.158245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.158245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.158245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.158245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.159205] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.241467] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.241467] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.241467] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.241467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.242078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.242078] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.242078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.242078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.242078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.242078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.242078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.242277] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.483664] env[70287]: INFO networking_nsxv3.common.synchronization [req-c9ed733f-d77b-4a16-9ec0-4c4cc87a36d6 req-6497a915-16b9-49ab-8bee-6ab47226f5d9 service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 866.483830] env[70287]: INFO networking_nsxv3.common.synchronization [req-c9ed733f-d77b-4a16-9ec0-4c4cc87a36d6 req-6497a915-16b9-49ab-8bee-6ab47226f5d9 service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 866.483991] env[70287]: INFO networking_nsxv3.common.synchronization [req-c9ed733f-d77b-4a16-9ec0-4c4cc87a36d6 req-6497a915-16b9-49ab-8bee-6ab47226f5d9 service nova] Enqueued Resource ID: 6c2c8849-9df1-4cdb-9c78-208de675f916 with Priority: HIGHEST for action port [ 866.484566] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 866.485356] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 866.485356] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6c2c8849-9df1-4cdb-9c78-208de675f916 with Priority: HIGHEST for action port [ 866.486122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.486725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.486725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.486725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.486878] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.487635] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.487751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.487817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.487992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.488153] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.488248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.488442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.488442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.488539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.488610] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.489519] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-6c2c8849-9df1-4cdb-9c78-208de675f916 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.489647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.489717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.489838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.489908] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6c2c8849-9df1-4cdb-9c78-208de675f916',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.662103] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.663864] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.664379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.664379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.664379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.664523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.664707] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.664807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.664915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.665409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.665490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.665543] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 866.695105] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.695105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.695105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.695105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.695105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.703962] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 866.747538] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aafb90fc-938c-44be-9296-60863884f367: rpc.has_security_group_logging(os_id): False [ 866.755163] env[70287]: INFO networking_nsxv3.common.synchronization [req-9333bc24-e2b7-45f6-afa7-34ec7fafc786 req-8b6af870-7125-467a-8c65-c1921893d2e8 tempest-InstanceActionsV221TestJSON-1154730883 tempest-InstanceActionsV221TestJSON-1154730883-project-member] Enqueued Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_members [ 866.755163] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGHEST for action security_group_members [ 866.755163] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.755446] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.755620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.755975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.756264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.756479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.756617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.756895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.757086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.757265] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.771832] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.771993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.772105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.772314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.772402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.774018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.774018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.774018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.774018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.774456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.774456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.774456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.774456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.774591] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 866.845580] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.845831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.845831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.846084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.846240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.864901] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 866.873772] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 866.874015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.874198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.874431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.874730] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.874837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.874837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.874983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.875078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.875192] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.992934] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.993126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.993373] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.997024] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6c2c8849-9df1-4cdb-9c78-208de675f916 with status ACTIVE [ 866.997024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.997024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.997024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.997024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.997024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.997024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.997650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.997724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.998187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.998408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.998743] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.998997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.999145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.000222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.000222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.000222] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6c2c8849-9df1-4cdb-9c78-208de675f916 is going to be updated. [ 867.030556] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.030556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.030556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.030556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.030556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.030556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6c2c8849-9df1-4cdb-9c78-208de675f916" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.169407] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3c4fea80-b8d6-423e-9f82-93c6ef731d08: rpc.has_security_group_logging(os_id): False [ 867.204620] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.204776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.204850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.205333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.205333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.205438] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.205510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.205572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.205727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.205804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.205893] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be updated. [ 867.260347] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.260686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.260858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.261173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.261364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.261734] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.261947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.262108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.263518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.263619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.263718] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae is going to be updated. [ 867.303176] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.303176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.303176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.303176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.303176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.321011] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.321011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.321011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.321011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.321011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.323605] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: IN_PROGRESS for 2s [ 867.334081] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae in Status: IN_PROGRESS for 2s [ 867.378212] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.378212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.378212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.378212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.378411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.378511] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.378609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.378692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.378851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.378972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.379029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 867.426417] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.426417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.426417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.426417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.426417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.440300] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 867.504877] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.639089] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 in Status: SUCCESS [ 867.639089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.639089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.639219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.639339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.639453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.639525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.639677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.639755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.639839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.639926] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.845742] env[70287]: INFO networking_nsxv3.common.synchronization [None req-920c5cdb-b53d-4874-992c-e54203dbd1a6 None None] Enqueued Resource ID: 68950dcb-631c-4dd3-bba4-1e9cc87151aa with Priority: HIGHEST for action port [ 867.845991] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68950dcb-631c-4dd3-bba4-1e9cc87151aa with Priority: HIGHEST for action port [ 867.848268] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-68950dcb-631c-4dd3-bba4-1e9cc87151aa taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.848448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68950dcb-631c-4dd3-bba4-1e9cc87151aa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.848521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68950dcb-631c-4dd3-bba4-1e9cc87151aa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.848794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68950dcb-631c-4dd3-bba4-1e9cc87151aa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.848879] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68950dcb-631c-4dd3-bba4-1e9cc87151aa',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.926344] env[70287]: INFO networking_nsxv3.common.synchronization [req-cfd2263c-98a6-48a6-ab1a-9cf536dea049 req-a4d19ad6-618d-48c0-828d-2f581c4cf92a tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 867.927019] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 867.927396] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.927579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.928016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.928016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.928016] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.928244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.928244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.933209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.933209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.933209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.007467] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.007643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.007717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.007946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.008052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.008185] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be created. [ 868.031535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.031763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.031763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.031956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.032177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.041610] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: UNINITIALIZED for 2s [ 868.142305] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.352870] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68950dcb-631c-4dd3-bba4-1e9cc87151aa [ 868.353151] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.353151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.353151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.353304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.353388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.353491] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68950dcb-631c-4dd3-bba4-1e9cc87151aa already deleted. [ 868.353573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68950dcb-631c-4dd3-bba4-1e9cc87151aa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.436307] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.436540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.436626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.436864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.436932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.437148] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.437247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.437309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.437457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.437532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.437619] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 868.464342] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.464342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.464342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.464342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.464342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.473699] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 868.645240] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eed43c9b-e09e-4fd2-87aa-ee48b0ab6706: rpc.has_security_group_logging(os_id): False [ 868.669372] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.669689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.669861] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.670187] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.670543] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.670876] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.671012] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.671600] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.671600] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.671764] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.671764] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 868.671890] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 868.672009] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 868.672141] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 868.672304] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 868.672580] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 868.683329] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.683485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.683542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.683753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.683847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.684133] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.684189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.684263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.684428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.684504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.684646] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 is going to be created. [ 868.700811] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 868.700998] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 868.701161] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 868.701348] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.701675] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-63f7a98c-088e-4d5b-b106-72362dba8fe8 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.701856] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.701979] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.702348] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.702498] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f7a98c-088e-4d5b-b106-72362dba8fe8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.722019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 868.722019] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 deletion is rescheduled due to dependency. [ 868.722019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.785030] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.785312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.785474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.785747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.785937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.797760] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 in Status: IN_PROGRESS for 2s [ 868.890965] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 868.891226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.205450] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.205724] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.205857] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.206195] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.206392] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.206548] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 63f7a98c-088e-4d5b-b106-72362dba8fe8 not found, creating... [ 869.206840] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.207063] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.207224] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.207477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.207617] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.207908] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.208272] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.208502] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.208824] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.209062] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.209340] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 63f7a98c-088e-4d5b-b106-72362dba8fe8 is going to be created. [ 869.241157] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.241711] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.241953] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.242311] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.242768] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.243104] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.341650] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 in Status: SUCCESS [ 869.341650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.392699] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae in Status: SUCCESS [ 869.392699] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae deletion is rescheduled due to dependency. [ 869.392699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.454446] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 869.454754] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d deletion is rescheduled due to dependency. [ 869.454909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.893733] env[70287]: INFO networking_nsxv3.common.synchronization [req-9c4248e8-7991-4788-b302-51a6e0654294 req-c07490ec-00d4-4fec-8035-5d99c1108c31 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_members [ 869.894372] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea with Priority: HIGHEST for action security_group_members [ 869.894627] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.894760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.894828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.895268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.895454] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.895574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.895672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.895824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.895913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.896040] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7e1295d-86bf-45fa-b2c1-808d7d01f3ea',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.052166] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 870.052464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.052671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.052901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.053127] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.053250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.053315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.053479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.053619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.053713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.053814] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.182196] env[70287]: INFO networking_nsxv3.common.synchronization [None req-12dfbd6f-e844-46b8-b4e6-6bb414d1d7c8 None None] Enqueued Resource ID: 2006e2f4-0500-4a18-b22e-ae3e48ef759f with Priority: HIGHEST for action port [ 870.183550] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2006e2f4-0500-4a18-b22e-ae3e48ef759f with Priority: HIGHEST for action port [ 870.184092] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2006e2f4-0500-4a18-b22e-ae3e48ef759f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.184229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2006e2f4-0500-4a18-b22e-ae3e48ef759f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.184299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2006e2f4-0500-4a18-b22e-ae3e48ef759f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.184637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2006e2f4-0500-4a18-b22e-ae3e48ef759f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.184732] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2006e2f4-0500-4a18-b22e-ae3e48ef759f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.400102] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.400877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.401316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.402681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.428944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.429442] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.429690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.429834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.430216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.430362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.430552] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea is going to be updated. [ 870.463216] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.463216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.463216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.463216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.463216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.471606] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea in Status: IN_PROGRESS for 2s [ 870.484473] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 870.484676] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 870.484786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.557860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.558042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.558116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.558348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.558909] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.559105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.559170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.559343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.559434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.559526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.559687] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.559786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.559848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.559992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.560152] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.560248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.560308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.560449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.560525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.560606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.560696] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.609041] env[70287]: INFO networking_nsxv3.common.synchronization [req-cfd2263c-98a6-48a6-ab1a-9cf536dea049 req-bf32e031-cc81-4511-9237-7863e318552f service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 870.609160] env[70287]: INFO networking_nsxv3.common.synchronization [req-cfd2263c-98a6-48a6-ab1a-9cf536dea049 req-bf32e031-cc81-4511-9237-7863e318552f service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 870.609257] env[70287]: INFO networking_nsxv3.common.synchronization [req-cfd2263c-98a6-48a6-ab1a-9cf536dea049 req-bf32e031-cc81-4511-9237-7863e318552f service nova] Enqueued Resource ID: 63f7a98c-088e-4d5b-b106-72362dba8fe8 with Priority: HIGHEST for action port [ 870.609748] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 870.609878] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 870.609974] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63f7a98c-088e-4d5b-b106-72362dba8fe8 with Priority: HIGHEST for action port [ 870.613793] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.613962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.613962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.614209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.614307] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.615969] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.615969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.615969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.615969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.615969] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.615969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.615969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.620287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.620656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.620656] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.621594] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-63f7a98c-088e-4d5b-b106-72362dba8fe8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.621710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.621710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.621897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.621977] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63f7a98c-088e-4d5b-b106-72362dba8fe8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.687999] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2006e2f4-0500-4a18-b22e-ae3e48ef759f [ 870.688278] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.688417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.688504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.688734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.688840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.688936] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2006e2f4-0500-4a18-b22e-ae3e48ef759f already deleted. [ 870.689067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2006e2f4-0500-4a18-b22e-ae3e48ef759f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.812325] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 in Status: SUCCESS [ 870.812688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.066249] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e5e0f30-956b-4713-b190-79d66c86985e: rpc.has_security_group_logging(os_id): False [ 871.083937] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.084226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.084350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.084708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.084910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.085255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.085449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.085577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.085834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.085986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.086314] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.086516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.086585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.086811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.087075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.087375] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.087569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.087665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.087899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.088054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.088219] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be created. [ 871.124187] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.126254] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.126254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.126254] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 63f7a98c-088e-4d5b-b106-72362dba8fe8 with status ACTIVE [ 871.126254] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.126254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.126254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.126601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.126601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.126601] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.126707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.126740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.127687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.127687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.129298] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.129611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.130061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.130646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.130646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.130646] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 63f7a98c-088e-4d5b-b106-72362dba8fe8 is going to be updated. [ 871.147265] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.147419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.147490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.147702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.147878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.153564] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.153717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.153773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.153962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.154117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.154281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63f7a98c-088e-4d5b-b106-72362dba8fe8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.162891] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 871.627118] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.130078] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.130280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.130376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.130628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.130737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.130860] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 872.168430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.168430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.168430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.168884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.170305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.177687] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 872.482135] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea in Status: SUCCESS [ 872.482338] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7e1295d-86bf-45fa-b2c1-808d7d01f3ea deletion is rescheduled due to dependency. [ 872.482421] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7e1295d-86bf-45fa-b2c1-808d7d01f3ea" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.177244] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 873.177244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.187477] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 874.187796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.187909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.188173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.188385] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.188507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.188637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.188736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.188834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.188921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.189029] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.691185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.691353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.691427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.691640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.691811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.691922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.691983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.692252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.692252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.692317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.692428] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.692532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.692593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.692710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.692845] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.692936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.692999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.693147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.693218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.693295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.693387] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.196879] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1f591-bba8-479c-a2de-cf9524dceb77: rpc.has_security_group_logging(os_id): False [ 875.216032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.216032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.216032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.216032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.216716] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.216716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.216716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.217984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.218322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.218525] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 875.277019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.277211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.277252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.277465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.277623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.297307] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 875.611426] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 875.611591] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 876.115685] env[70287]: INFO networking_nsxv3.common.synchronization [req-85512cf9-cf8c-47f5-9d5e-2ab3d94876f6 req-cdf96cac-bf94-420d-a956-c4891bfc5631 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 876.117583] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 876.117931] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.118069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.118132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.118458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.118986] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.119206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.119272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.119871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.119871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.119871] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.510680] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.511076] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.511076] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.511396] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.512942] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.512942] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.512942] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.514425] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.514640] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.514891] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.515057] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.515591] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.515756] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.515898] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 876.516033] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.516207] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.537222] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.540371] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 876.540546] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.540760] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.541149] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.541376] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.541508] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.541855] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.542048] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e0b2995-3a48-46d2-9f39-4a1dc1701c93',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.622027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.622237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.622292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.622525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.622671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.622901] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.623013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.623103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.623355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.623432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.623525] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 already deleted. [ 876.623702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.045049] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.045574] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.045841] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.046413] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.046711] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.047058] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 1e0b2995-3a48-46d2-9f39-4a1dc1701c93 not found, creating... [ 877.047552] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.048273] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.048600] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.048858] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.049335] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.049805] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.050022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.050208] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.050487] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.050657] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.050842] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 1e0b2995-3a48-46d2-9f39-4a1dc1701c93 is going to be created. [ 877.074230] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.074676] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.074749] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.075577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.075577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.075766] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.317072] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 877.317307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.839637] env[70287]: INFO networking_nsxv3.common.synchronization [req-85512cf9-cf8c-47f5-9d5e-2ab3d94876f6 req-78f8700d-908e-40f0-b64d-ca6f760b7f1a service nova] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 877.839946] env[70287]: INFO networking_nsxv3.common.synchronization [req-85512cf9-cf8c-47f5-9d5e-2ab3d94876f6 req-78f8700d-908e-40f0-b64d-ca6f760b7f1a service nova] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 877.839946] env[70287]: INFO networking_nsxv3.common.synchronization [req-85512cf9-cf8c-47f5-9d5e-2ab3d94876f6 req-78f8700d-908e-40f0-b64d-ca6f760b7f1a service nova] Enqueued Resource ID: 1e0b2995-3a48-46d2-9f39-4a1dc1701c93 with Priority: HIGHEST for action port [ 877.840200] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 877.840328] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 877.840427] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e0b2995-3a48-46d2-9f39-4a1dc1701c93 with Priority: HIGHEST for action port [ 877.842120] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.842120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.842120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.842507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.842507] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.846903] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.847132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.847178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.847436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.847500] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.847594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.847657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.847802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.847874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.847968] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.849600] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.849734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.849806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.849928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.850036] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e0b2995-3a48-46d2-9f39-4a1dc1701c93',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.197595] env[70287]: INFO networking_nsxv3.common.synchronization [req-a1e8eb42-1346-4103-9a26-50e3d39f8eea req-5e45a701-f15a-4028-b5e4-3d28c0357f56 tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 878.198064] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 878.198387] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.198512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.198591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.198772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.198925] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.206425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.206425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.206425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.206425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.206425] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.354231] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.354231] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.354231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.361273] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e0b2995-3a48-46d2-9f39-4a1dc1701c93 with status ACTIVE [ 878.361273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.361273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.361273] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.361273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.361273] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e0b2995-3a48-46d2-9f39-4a1dc1701c93 is going to be updated. [ 878.381127] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.381281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.381353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.381558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.381698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.382382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e0b2995-3a48-46d2-9f39-4a1dc1701c93" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.705884] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.854714] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.209185] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.360723] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.360940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.361080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.361369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.361494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.361629] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be created. [ 879.400245] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.400395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.400451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.400667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.400817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.411456] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: UNINITIALIZED for 2s [ 879.711040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.711040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.711040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.711228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.711228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.711333] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 879.745590] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.745590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.745590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.745590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.745590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.756792] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 880.628608] env[70287]: INFO networking_nsxv3.common.synchronization [None req-4df05289-82bc-4268-aad3-92ddbd8e7254 None None] Enqueued Resource ID: 9bbc315a-f797-4f90-aa48-e34253e61e42 with Priority: HIGHEST for action port [ 880.629162] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bbc315a-f797-4f90-aa48-e34253e61e42 with Priority: HIGHEST for action port [ 880.630620] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bbc315a-f797-4f90-aa48-e34253e61e42 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.630816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bbc315a-f797-4f90-aa48-e34253e61e42" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.630935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bbc315a-f797-4f90-aa48-e34253e61e42" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.631772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bbc315a-f797-4f90-aa48-e34253e61e42" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.633202] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bbc315a-f797-4f90-aa48-e34253e61e42',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.900534] env[70287]: INFO networking_nsxv3.common.synchronization [req-2c203950-e8f0-4b5d-b17b-30d8d5ca4c6f req-3a04479c-fa5a-49b3-9540-156ec952bf96 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 880.901158] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 880.901523] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.901668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.901740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.901984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.902338] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.902503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.902620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.902854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.902980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.903151] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.136044] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bbc315a-f797-4f90-aa48-e34253e61e42 [ 881.136165] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.136261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.136261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.136464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.136547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.136648] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bbc315a-f797-4f90-aa48-e34253e61e42 already deleted. [ 881.136716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bbc315a-f797-4f90-aa48-e34253e61e42" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.405433] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.427685] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 881.427905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.428368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.428587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.428778] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.428899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.428965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.429137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.429219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.429305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.429405] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.710922] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.710922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.710922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.710922] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.710922] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.712201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.712201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.712201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.712201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.712201] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.712201] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.713227] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.713227] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.713227] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 881.713227] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.713227] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.731966] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.732294] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 881.732503] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.732849] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.733270] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f99957de-e02f-4cb2-b3ea-8508f463b7f2 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.733543] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.733714] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.734118] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.734335] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f99957de-e02f-4cb2-b3ea-8508f463b7f2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.769694] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 881.769694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.912601] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.931635] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.236827] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.237148] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.237303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.237635] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.237808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.238047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f99957de-e02f-4cb2-b3ea-8508f463b7f2 not found, creating... [ 882.238315] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.238515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.238674] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.238910] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.241309] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.241777] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.243016] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.243016] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.243016] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.243016] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.243016] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f99957de-e02f-4cb2-b3ea-8508f463b7f2 is going to be created. [ 882.268536] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.268825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.268948] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.269275] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.269533] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.269787] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.313794] env[70287]: INFO networking_nsxv3.common.synchronization [req-583da7af-2d6a-4366-89dd-6b9e9fe77137 req-33902ca0-59ea-4a35-a126-dd5ba3fa242b tempest-SecurityGroupRulesTestJSON-2035240796 tempest-SecurityGroupRulesTestJSON-2035240796-project-member] Enqueued Resource ID: d3c0ba1a-e492-4091-8612-aab0121c5570 with Priority: HIGHEST for action security_group_rules [ 882.313989] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3c0ba1a-e492-4091-8612-aab0121c5570 with Priority: HIGHEST for action security_group_rules [ 882.314523] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3c0ba1a-e492-4091-8612-aab0121c5570 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.314668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3c0ba1a-e492-4091-8612-aab0121c5570" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.314799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3c0ba1a-e492-4091-8612-aab0121c5570" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.315118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3c0ba1a-e492-4091-8612-aab0121c5570" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.315294] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3c0ba1a-e492-4091-8612-aab0121c5570',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.417727] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.417965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.418252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.418406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.418406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.418521] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 882.435348] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2d197f8-6ecf-4737-ae78-a66d15978937: rpc.has_security_group_logging(os_id): False [ 882.452597] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.452694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.452734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.452960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.453069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.453322] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.453466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.453532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.453695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.453776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.453865] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be created. [ 882.459808] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.459938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.460013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.460198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.460331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.470621] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 882.533033] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.533190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.533263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.533473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.533672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.545125] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 882.836844] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.837248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.837248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.837564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.837564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.837564] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3c0ba1a-e492-4091-8612-aab0121c5570 already deleted. [ 882.837564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3c0ba1a-e492-4091-8612-aab0121c5570" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.085315] env[70287]: INFO networking_nsxv3.common.synchronization [req-2c203950-e8f0-4b5d-b17b-30d8d5ca4c6f req-feeafd8a-17b4-4e87-93c6-caa807ff7b35 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 883.085496] env[70287]: INFO networking_nsxv3.common.synchronization [req-2c203950-e8f0-4b5d-b17b-30d8d5ca4c6f req-feeafd8a-17b4-4e87-93c6-caa807ff7b35 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 883.085636] env[70287]: INFO networking_nsxv3.common.synchronization [req-2c203950-e8f0-4b5d-b17b-30d8d5ca4c6f req-feeafd8a-17b4-4e87-93c6-caa807ff7b35 service nova] Enqueued Resource ID: f99957de-e02f-4cb2-b3ea-8508f463b7f2 with Priority: HIGHEST for action port [ 883.085899] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 883.086038] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 883.086141] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f99957de-e02f-4cb2-b3ea-8508f463b7f2 with Priority: HIGHEST for action port [ 883.086701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.086836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.086891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.087127] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.087216] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.088012] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.088580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.088580] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f99957de-e02f-4cb2-b3ea-8508f463b7f2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.088580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.088580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.088736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.088736] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f99957de-e02f-4cb2-b3ea-8508f463b7f2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.132781] env[70287]: INFO networking_nsxv3.common.synchronization [None req-254ae8c5-2962-415f-b2c4-fc17670326f7 None None] Enqueued Resource ID: ba3e63e2-f14b-4903-be82-04f98cdc31ff with Priority: HIGHEST for action port [ 883.133434] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba3e63e2-f14b-4903-be82-04f98cdc31ff with Priority: HIGHEST for action port [ 883.133841] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba3e63e2-f14b-4903-be82-04f98cdc31ff taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.135375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba3e63e2-f14b-4903-be82-04f98cdc31ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.135375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba3e63e2-f14b-4903-be82-04f98cdc31ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.135375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba3e63e2-f14b-4903-be82-04f98cdc31ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.135375] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba3e63e2-f14b-4903-be82-04f98cdc31ff',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.187537] env[70287]: INFO networking_nsxv3.common.synchronization [req-092985b4-7af3-4eb2-938d-2b862bb67972 req-cd30912c-168b-4908-897b-485a652db904 tempest-SecurityGroupRulesTestJSON-2035240796 tempest-SecurityGroupRulesTestJSON-2035240796-project-member] Enqueued Resource ID: f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef with Priority: HIGHEST for action security_group_rules [ 883.188114] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef with Priority: HIGHEST for action security_group_rules [ 883.188383] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.188502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.188681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.189019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.189019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.590465] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.590655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.590881] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f99957de-e02f-4cb2-b3ea-8508f463b7f2 with status ACTIVE [ 883.592388] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.592547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.592643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.592891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.593216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.593216] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.593372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.593372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.593500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.593575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.593775] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.593877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.593937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.594100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.594175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.594258] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f99957de-e02f-4cb2-b3ea-8508f463b7f2 is going to be updated. [ 883.615579] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.615579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.615579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.615579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.615579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.615579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f99957de-e02f-4cb2-b3ea-8508f463b7f2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.636863] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba3e63e2-f14b-4903-be82-04f98cdc31ff [ 883.636863] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.636863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.637201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.637201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.637321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.637453] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba3e63e2-f14b-4903-be82-04f98cdc31ff already deleted. [ 883.637593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba3e63e2-f14b-4903-be82-04f98cdc31ff" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.729862] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.730012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.730088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.731062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.731254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.731302] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef already deleted. [ 883.731389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2d9efb8-d00c-4215-bf52-1dfe4bd7f4ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.925301] env[70287]: INFO networking_nsxv3.common.synchronization [req-8fefd7fd-077a-4e89-8db9-f797dc4bb480 req-93dd8a09-72e3-4050-a69b-b36da3fd65fb tempest-SecurityGroupRulesTestJSON-2035240796 tempest-SecurityGroupRulesTestJSON-2035240796-project-member] Enqueued Resource ID: 6390e1e0-5c5b-41ab-99fd-714286b507e6 with Priority: HIGHEST for action security_group_rules [ 883.925862] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6390e1e0-5c5b-41ab-99fd-714286b507e6 with Priority: HIGHEST for action security_group_rules [ 883.926910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6390e1e0-5c5b-41ab-99fd-714286b507e6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.927088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6390e1e0-5c5b-41ab-99fd-714286b507e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.927135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6390e1e0-5c5b-41ab-99fd-714286b507e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.927431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6390e1e0-5c5b-41ab-99fd-714286b507e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.927511] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6390e1e0-5c5b-41ab-99fd-714286b507e6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.448654] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.448654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.448654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.448654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.448654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.448654] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6390e1e0-5c5b-41ab-99fd-714286b507e6 already deleted. [ 884.448654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6390e1e0-5c5b-41ab-99fd-714286b507e6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.480966] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 884.481210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.481379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.481592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.484051] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.484051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.484051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.484051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.484051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.484051] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.557220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 884.557548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.791987] env[70287]: INFO networking_nsxv3.common.synchronization [req-b9fcf4e9-c6b6-4957-a822-8c0d0d5c356d req-e295e0a7-ca60-4b1b-ac30-f2761e952ac2 tempest-SecurityGroupRulesTestJSON-2035240796 tempest-SecurityGroupRulesTestJSON-2035240796-project-member] Enqueued Resource ID: 85204138-ed60-472e-81c7-af188aeb1098 with Priority: HIGHEST for action security_group_rules [ 884.792621] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85204138-ed60-472e-81c7-af188aeb1098 with Priority: HIGHEST for action security_group_rules [ 884.792916] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-85204138-ed60-472e-81c7-af188aeb1098 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.793122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-85204138-ed60-472e-81c7-af188aeb1098" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.793218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-85204138-ed60-472e-81c7-af188aeb1098" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.793516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-85204138-ed60-472e-81c7-af188aeb1098" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.793632] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('85204138-ed60-472e-81c7-af188aeb1098',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.987607] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.996647] env[70287]: INFO networking_nsxv3.common.synchronization [req-90de4106-8697-4c18-9f0a-30ca64e549bf req-db012a24-cc26-4fc5-b6c5-93556434631c tempest-MigrationsAdminTest-1148431189 tempest-MigrationsAdminTest-1148431189-project-member] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 885.001206] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 885.004461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.004704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.004704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.005060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.005250] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.005359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.005424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.005588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.005677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.005799] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.320162] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.320162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.320162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.320480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.320687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.320898] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 85204138-ed60-472e-81c7-af188aeb1098 already deleted. [ 885.321103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-85204138-ed60-472e-81c7-af188aeb1098" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.492284] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.511320] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.996440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.996440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.996440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.997427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.997427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.997427] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 886.013307] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.032468] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.032468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.032468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.032798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.032849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.042714] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 886.138175] env[70287]: INFO networking_nsxv3.common.synchronization [req-6e05edfd-afb6-43a9-bdbd-fae199847a79 req-73edd976-d8f1-4310-be22-f1792b8c1af9 tempest-SecurityGroupRulesTestJSON-2035240796 tempest-SecurityGroupRulesTestJSON-2035240796-project-member] Enqueued Resource ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 with Priority: HIGHEST for action security_group_rules [ 886.138175] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 with Priority: HIGHEST for action security_group_rules [ 886.138175] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b7a05a0-86c9-4ddc-8711-196b9913d297 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.138175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.138602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.138602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.138602] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b7a05a0-86c9-4ddc-8711-196b9913d297',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.503627] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-90e70b44-cc1f-4796-9b36-2a38f38b5765 tempest-ListServersNegativeTestJSON-1716050224 tempest-ListServersNegativeTestJSON-1716050224-project-member] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 886.505340] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 886.506386] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.506386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.506386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.506386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.506386] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.506790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.506790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.506790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.506790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.506915] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.516169] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.516462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.516552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.516770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.516858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.516960] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be updated. [ 886.546347] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.546487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.546539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.546745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.546901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.560238] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: IN_PROGRESS for 2s [ 886.650280] env[70287]: INFO networking_nsxv3.common.synchronization [req-c9c40bb7-44bc-4a95-95cd-d187aa84d094 req-bcf19a7c-c8e5-4a81-8aa4-f9cf17e89b89 tempest-SecurityGroupRulesTestJSON-2035240796 tempest-SecurityGroupRulesTestJSON-2035240796-project-member] Enqueued Resource ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 with Priority: HIGHEST for action security_group_rules [ 886.650700] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 with Priority: HIGHEST for action security_group_rules [ 886.651039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b7a05a0-86c9-4ddc-8711-196b9913d297 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.651154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.665482] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.665659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.665699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.665897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.665993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.666261] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 already deleted. [ 886.666261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.666348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.667951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.667951] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b7a05a0-86c9-4ddc-8711-196b9913d297',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.009077] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.009448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.009703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.010043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.010204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.010373] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.010535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.010594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.010824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.010902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.010996] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d already deleted. [ 887.011142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.158092] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.160023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.160023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.160023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.160023] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.160023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.160023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.160605] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.160605] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.160605] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.160773] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.160934] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.161082] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.161212] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 887.161348] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.161526] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.186292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.186488] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 887.186604] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.186792] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.187194] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-9633f7db-c009-4d19-8983-349c846f1e9b taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.187390] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.187534] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.187908] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.188073] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9633f7db-c009-4d19-8983-349c846f1e9b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.196034] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.196260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.196335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.196614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.196752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.196877] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 already deleted. [ 887.197175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.324537] env[70287]: INFO networking_nsxv3.common.synchronization [req-e7fb45b0-2ac3-4a16-ad96-b1bafa8a9270 req-33e4fd10-9a30-4bf9-94d2-3c3eb5b77f76 tempest-SecurityGroupRulesTestJSON-2035240796 tempest-SecurityGroupRulesTestJSON-2035240796-project-member] Enqueued Resource ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 with Priority: HIGHEST for action security_group_rules [ 887.325187] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 with Priority: HIGHEST for action security_group_rules [ 887.325573] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b7a05a0-86c9-4ddc-8711-196b9913d297 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.325625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.325709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.325901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.325982] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b7a05a0-86c9-4ddc-8711-196b9913d297',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.695036] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.695246] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.695426] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.695797] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.696023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.696247] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 9633f7db-c009-4d19-8983-349c846f1e9b not found, creating... [ 887.696638] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.696898] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.697049] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.697352] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.697511] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.697873] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.698098] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.698308] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.698469] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.698641] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.698813] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 9633f7db-c009-4d19-8983-349c846f1e9b is going to be created. [ 887.719322] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.719552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.719681] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.720018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.720228] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.720473] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.853033] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.853033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.853417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.853417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.853711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.853711] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b7a05a0-86c9-4ddc-8711-196b9913d297 already deleted. [ 887.853865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b7a05a0-86c9-4ddc-8711-196b9913d297" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.058973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 888.059294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.060021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.060021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.060021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.060021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.060021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.060293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.060293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.060360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.060458] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.562787] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.562787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.562787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.563031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.563227] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.563359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.563391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.564111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.564111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.564111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.564111] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.564111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.565098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.565098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.565098] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.565098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.565459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.565459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.568370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.568370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.568370] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.574211] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: SUCCESS [ 888.574706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.858340] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-d081ec52-dc23-4b32-ad07-7e20dbeb24de service nova] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_rules [ 888.858340] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-d081ec52-dc23-4b32-ad07-7e20dbeb24de service nova] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 888.858340] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-d081ec52-dc23-4b32-ad07-7e20dbeb24de service nova] Enqueued Resource ID: 9633f7db-c009-4d19-8983-349c846f1e9b with Priority: HIGHEST for action port [ 888.858340] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_rules [ 888.858340] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 888.858340] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9633f7db-c009-4d19-8983-349c846f1e9b with Priority: HIGHEST for action port [ 888.858340] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.858340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.858340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.858641] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.858671] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.859576] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.862656] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.862656] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.862656] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9633f7db-c009-4d19-8983-349c846f1e9b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.862656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.863062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.863062] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9633f7db-c009-4d19-8983-349c846f1e9b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.890068] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-fc2c65cc-b729-4408-856a-cd59686bd4ee tempest-ListServersNegativeTestJSON-1716050224 tempest-ListServersNegativeTestJSON-1716050224-project-member] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 888.891432] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 888.892253] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.892480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.068590] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 889.087125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.087125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.087125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.087125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.087637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.088199] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.088199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.088199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.088549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.088549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.088549] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 889.143264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.143434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.143633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.144076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.144076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.157944] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 889.321738] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.321952] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.322112] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.322387] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.322643] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.322830] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.322969] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.323785] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.323785] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.323785] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.323941] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.323975] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.324110] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.324231] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 889.324324] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.324456] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.342540] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.342758] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 889.342905] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.343100] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.343596] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-94cdb09d-15cd-4f64-bfba-1588d733bece taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.343802] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.343925] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.344266] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.344407] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cdb09d-15cd-4f64-bfba-1588d733bece',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.364989] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.364989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.365282] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.369025] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9633f7db-c009-4d19-8983-349c846f1e9b with status ACTIVE [ 889.369025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.369025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.369025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.369025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.369025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.369025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.369756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.369756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.369938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.370479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.370719] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.370858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.371384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.371384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.371384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.371384] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9633f7db-c009-4d19-8983-349c846f1e9b is going to be updated. [ 889.395119] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.395275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.395346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.395571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.395847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.395915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9633f7db-c009-4d19-8983-349c846f1e9b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.849329] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.849329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.849329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.849329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.849329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.849329] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 94cdb09d-15cd-4f64-bfba-1588d733bece not found, creating... [ 889.849329] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.849329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.849329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.849329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.849850] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.849850] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.849850] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.849970] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.850947] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.850947] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.850947] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 94cdb09d-15cd-4f64-bfba-1588d733bece is going to be created. [ 889.868516] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.870159] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.870370] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.870503] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.870786] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.871034] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.871280] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.373550] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.373550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.373550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.373963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.374018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.374121] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be created. [ 890.398065] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.398219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.398297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.398643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.398643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.407601] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: UNINITIALIZED for 2s [ 890.712823] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-a981216f-58d1-476f-b298-d3aee34623d9 service nova] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_rules [ 890.713838] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-a981216f-58d1-476f-b298-d3aee34623d9 service nova] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 890.714538] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-a981216f-58d1-476f-b298-d3aee34623d9 service nova] Enqueued Resource ID: 94cdb09d-15cd-4f64-bfba-1588d733bece with Priority: HIGHEST for action port [ 890.715581] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_rules [ 890.715720] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 890.715844] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cdb09d-15cd-4f64-bfba-1588d733bece with Priority: HIGHEST for action port [ 890.716165] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.716279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.716767] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.716767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.716767] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-94cdb09d-15cd-4f64-bfba-1588d733bece taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.716956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.716956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.717119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.717206] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94cdb09d-15cd-4f64-bfba-1588d733bece',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.175495] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 891.175740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.222150] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94cdb09d-15cd-4f64-bfba-1588d733bece with status ACTIVE [ 891.222150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.222150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.222150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.222150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.222150] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94cdb09d-15cd-4f64-bfba-1588d733bece is going to be updated. [ 891.240058] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.240201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.240256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.240467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.240607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.240774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94cdb09d-15cd-4f64-bfba-1588d733bece" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.870499] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-13093475-aa6f-462d-a326-8d9154ebd350 tempest-ListServersNegativeTestJSON-1716050224 tempest-ListServersNegativeTestJSON-1716050224-project-member] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 891.871937] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 891.871937] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.871937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.419835] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 892.420251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.420541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.420843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.421150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.421486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.421649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.422130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.422332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.423019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.539904] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-911 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.540080] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.541307] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.541307] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.541307] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.541628] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.541767] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.542071] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.542251] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.542485] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.542620] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.542735] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.542890] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.543045] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 892.543184] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.543340] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.561056] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.561264] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 892.561421] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.561691] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-911" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.561970] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-9b4b21f1-0c69-4495-82ed-6a9343efc892 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.562192] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.562432] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.562821] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.563029] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b4b21f1-0c69-4495-82ed-6a9343efc892',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.927639] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.066726] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.067024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.067162] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.067494] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.069701] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.070346] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 9b4b21f1-0c69-4495-82ed-6a9343efc892 not found, creating... [ 893.070346] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.070494] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.070635] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.071323] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.071323] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.071416] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.071620] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.071792] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.072683] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.072683] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.072683] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 9b4b21f1-0c69-4495-82ed-6a9343efc892 is going to be created. [ 893.092133] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.093774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.093774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.093774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.093774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.094057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.430529] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.930361] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-4f2f1e9d-91ae-407d-8419-2649ae7c898a service nova] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_rules [ 893.930656] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-4f2f1e9d-91ae-407d-8419-2649ae7c898a service nova] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 893.930690] env[70287]: INFO networking_nsxv3.common.synchronization [req-fb8e4456-ab2e-4b13-a268-465f138897bd req-4f2f1e9d-91ae-407d-8419-2649ae7c898a service nova] Enqueued Resource ID: 9b4b21f1-0c69-4495-82ed-6a9343efc892 with Priority: HIGHEST for action port [ 893.930904] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_rules [ 893.932137] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 893.932137] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b4b21f1-0c69-4495-82ed-6a9343efc892 with Priority: HIGHEST for action port [ 893.932137] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.932137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.935942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.935942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.935942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b4b21f1-0c69-4495-82ed-6a9343efc892 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.935942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.935942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.935942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.935942] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b4b21f1-0c69-4495-82ed-6a9343efc892',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.936848] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.936949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.937111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.937237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.937353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.937429] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 893.971363] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.971521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.971591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.971854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.972012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.982508] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 894.449161] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b4b21f1-0c69-4495-82ed-6a9343efc892 with status ACTIVE [ 894.449161] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.449161] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.449161] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.449161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.449161] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b4b21f1-0c69-4495-82ed-6a9343efc892 is going to be updated. [ 894.466482] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.466769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.466769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.466887] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.467028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.467359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b4b21f1-0c69-4495-82ed-6a9343efc892" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.993047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 895.993536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.994641] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.994641] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.994641] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.994946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.995514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.997277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.997277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.997381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.997719] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.998999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.999166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.999395] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.999988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.999988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.999988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.999988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.999988] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.501565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.501767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.502170] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.004263] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.508289] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.508531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.508609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.508831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.508925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.509075] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 897.537024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.537195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.537270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.537490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.537636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.547067] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 898.508266] env[70287]: INFO networking_nsxv3.common.synchronization [None req-4b5b9367-4995-4e4b-ac15-a26d1ca1351f tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 898.508679] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 898.509279] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.509507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.509595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.509907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.510036] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.631649] env[70287]: INFO networking_nsxv3.common.synchronization [None req-73a250b1-2550-4c16-9ceb-239e2049fa33 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 898.632300] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 898.632640] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.632801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.030530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.030717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.031380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.031952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.032151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.032315] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 already deleted. [ 899.032473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.032705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.032967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.034200] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.557038] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 899.557338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.557510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.557677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.557869] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.558143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.558143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.558207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.558296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.558390] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.563702] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.563835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.563986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.564206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.564339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.564519] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 already deleted. [ 899.564637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.066447] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.570387] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.964621] env[70287]: INFO networking_nsxv3.common.synchronization [req-a2707c33-5a34-4913-ae7b-a6c99ea4d895 req-c8927d01-007e-4560-83cf-bfa8ec89409b tempest-ServersWithSpecificFlavorTestJSON-185056864 tempest-ServersWithSpecificFlavorTestJSON-185056864-project-member] Enqueued Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 900.965232] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 with Priority: HIGHEST for action security_group_members [ 900.965515] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.965627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.965688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.965877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.970096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.970096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.970096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.970225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.972388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.972388] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac98ad7d-21c7-4c9e-add9-9d7467bf4897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.074069] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.074244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.074369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.074649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.074751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.074853] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 901.107699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.107884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.107944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.108242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.108414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.117737] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 901.259195] env[70287]: INFO networking_nsxv3.common.synchronization [req-cd6d23be-05a4-49e8-abd7-202a88751f3b req-99e72563-5c87-4c8e-a3ad-0f7612418199 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_members [ 901.264375] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_members [ 901.265271] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.265401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.265491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.265896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.266869] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.266869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.266869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.267060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.267091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.267199] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.424165] env[70287]: INFO networking_nsxv3.common.synchronization [None req-8472ae03-14a5-4ff0-91fe-58bb80d9947e None None] Enqueued Resource ID: 8430af0b-e627-45b7-ac00-b6b27230ba32 with Priority: HIGHEST for action port [ 901.424165] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8430af0b-e627-45b7-ac00-b6b27230ba32 with Priority: HIGHEST for action port [ 901.425055] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-8430af0b-e627-45b7-ac00-b6b27230ba32 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.425055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8430af0b-e627-45b7-ac00-b6b27230ba32" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.425600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8430af0b-e627-45b7-ac00-b6b27230ba32" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.425925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8430af0b-e627-45b7-ac00-b6b27230ba32" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.426036] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8430af0b-e627-45b7-ac00-b6b27230ba32',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.474730] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.474730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.474730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.474730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.476176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.476176] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.476176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.476176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.476176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.476176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.476176] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 is going to be updated. [ 901.516407] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.516562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.516636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.516843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.516985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.526224] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: IN_PROGRESS for 2s [ 901.773669] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.773891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.773891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.774141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.774237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.775392] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.775392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.775392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.775392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.775392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.775392] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 already deleted. [ 901.775392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.881874] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.882121] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.882288] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.882584] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.882843] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.883093] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.883252] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.883478] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.883626] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.883833] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.884016] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.884118] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.884173] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.884279] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 901.884390] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.884518] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.904425] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.904425] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 901.904425] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.904425] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.904657] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f36957aa-3c4b-48bc-bbb4-548910ef40db taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.904767] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.904912] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.905367] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.906203] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f36957aa-3c4b-48bc-bbb4-548910ef40db',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.930689] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8430af0b-e627-45b7-ac00-b6b27230ba32 [ 901.930689] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.930689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.930689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.930689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.930972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.930972] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8430af0b-e627-45b7-ac00-b6b27230ba32 already deleted. [ 901.931146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8430af0b-e627-45b7-ac00-b6b27230ba32" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.411724] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.411923] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.412382] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.412382] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.412489] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.413103] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f36957aa-3c4b-48bc-bbb4-548910ef40db not found, creating... [ 902.413103] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.413835] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.413835] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.413835] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.413835] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.418034] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.418034] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.418034] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.418034] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.418034] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.418034] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f36957aa-3c4b-48bc-bbb4-548910ef40db is going to be created. [ 902.446459] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.446792] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.447047] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.447719] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.447828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.452477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.128293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 903.128544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.128711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.129589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.129589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.129589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.129589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.129589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.129787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.129787] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.289261] env[70287]: INFO networking_nsxv3.common.synchronization [req-cd6d23be-05a4-49e8-abd7-202a88751f3b req-e1cad231-23b1-4b0d-8eea-f514fce32dcd service nova] Enqueued Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_rules [ 903.289458] env[70287]: INFO networking_nsxv3.common.synchronization [req-cd6d23be-05a4-49e8-abd7-202a88751f3b req-e1cad231-23b1-4b0d-8eea-f514fce32dcd service nova] Enqueued Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_members [ 903.289603] env[70287]: INFO networking_nsxv3.common.synchronization [req-cd6d23be-05a4-49e8-abd7-202a88751f3b req-e1cad231-23b1-4b0d-8eea-f514fce32dcd service nova] Enqueued Resource ID: f36957aa-3c4b-48bc-bbb4-548910ef40db with Priority: HIGHEST for action port [ 903.290159] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_rules [ 903.290296] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_members [ 903.290393] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f36957aa-3c4b-48bc-bbb4-548910ef40db with Priority: HIGHEST for action port [ 903.290664] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.290786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.290850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.291065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.291147] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.291948] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.292346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.292346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.292346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.292514] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.292514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.292624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.292713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.292798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.292884] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.293670] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f36957aa-3c4b-48bc-bbb4-548910ef40db taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.293760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.293760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.293915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.293989] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f36957aa-3c4b-48bc-bbb4-548910ef40db',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.470369] env[70287]: INFO networking_nsxv3.common.synchronization [None req-b0c2f802-3a9d-4be8-aea9-ada86176977d None None] Enqueued Resource ID: 4d49016f-3a27-493e-a4a5-405ca1e72b71 with Priority: HIGHEST for action port [ 903.470369] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d49016f-3a27-493e-a4a5-405ca1e72b71 with Priority: HIGHEST for action port [ 903.470369] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d49016f-3a27-493e-a4a5-405ca1e72b71 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.470369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d49016f-3a27-493e-a4a5-405ca1e72b71" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.470369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d49016f-3a27-493e-a4a5-405ca1e72b71" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.470369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d49016f-3a27-493e-a4a5-405ca1e72b71" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.470369] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d49016f-3a27-493e-a4a5-405ca1e72b71',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.536453] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 in Status: SUCCESS [ 903.536453] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac98ad7d-21c7-4c9e-add9-9d7467bf4897 deletion is rescheduled due to dependency. [ 903.536453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac98ad7d-21c7-4c9e-add9-9d7467bf4897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.613988] env[70287]: INFO networking_nsxv3.common.synchronization [req-a1917aea-8fab-49f3-9d0e-44b9c28ad3d9 req-02a0d663-35df-47af-b7f6-d75055b20f48 tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 903.614739] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 903.615373] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.615579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.615727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.616697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.616911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.617512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.617838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.617838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.618440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.618610] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.632418] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.796442] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.796442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.799098] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.799098] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f36957aa-3c4b-48bc-bbb4-548910ef40db with status ACTIVE [ 903.799098] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.799098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.799098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.799098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.799098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.799577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.799577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.799577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.799577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.799765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.799813] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.799909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.799981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.800707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.800849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.800949] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f36957aa-3c4b-48bc-bbb4-548910ef40db is going to be updated. [ 903.838192] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.838370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.838443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.838650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.838785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.838948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f36957aa-3c4b-48bc-bbb4-548910ef40db" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.971224] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d49016f-3a27-493e-a4a5-405ca1e72b71 [ 903.971456] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.971585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.971650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.971899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.972052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.972152] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d49016f-3a27-493e-a4a5-405ca1e72b71 already deleted. [ 903.973342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d49016f-3a27-493e-a4a5-405ca1e72b71" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.068276] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.068894] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.068894] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.069044] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.069335] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.069446] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.069621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.069772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.069920] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.070146] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.070261] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.070371] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.070480] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.070589] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 904.070695] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.070828] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.089610] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.089742] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 904.090554] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.090818] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-766" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.091163] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-2b3f3811-2ee5-42d4-bd84-201e64e54b58 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.091348] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.091473] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.091788] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.091932] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b3f3811-2ee5-42d4-bd84-201e64e54b58',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.120965] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.121327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.121401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.121607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.121696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.121894] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.121989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.122079] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.122405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.122510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.122605] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 904.134125] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.153809] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.153962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.154044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.154246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.154389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.163782] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 904.303335] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.595704] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.595944] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.596137] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.596442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.597029] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.597029] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 2b3f3811-2ee5-42d4-bd84-201e64e54b58 not found, creating... [ 904.597332] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.597332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.597424] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.597577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.597736] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.598044] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.598207] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.599305] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.599305] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.599305] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.599305] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 2b3f3811-2ee5-42d4-bd84-201e64e54b58 is going to be created. [ 904.618889] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.619603] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.619603] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.619603] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.619783] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.620343] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.637194] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.637523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.637621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.637848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.638096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.638199] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 904.670735] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.671056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.671056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.671290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.672194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.692055] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 904.805822] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.806284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.806452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.806922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.807195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.807411] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 is going to be created. [ 904.834756] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.834981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.835089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.835378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.835596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.847097] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 in Status: UNINITIALIZED for 2s [ 905.432888] env[70287]: INFO networking_nsxv3.common.synchronization [req-a1917aea-8fab-49f3-9d0e-44b9c28ad3d9 req-cd0a1e4f-f1d0-4675-ab7f-236ae210fad7 service nova] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_rules [ 905.432888] env[70287]: INFO networking_nsxv3.common.synchronization [req-a1917aea-8fab-49f3-9d0e-44b9c28ad3d9 req-cd0a1e4f-f1d0-4675-ab7f-236ae210fad7 service nova] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 905.435148] env[70287]: INFO networking_nsxv3.common.synchronization [req-a1917aea-8fab-49f3-9d0e-44b9c28ad3d9 req-cd0a1e4f-f1d0-4675-ab7f-236ae210fad7 service nova] Enqueued Resource ID: 2b3f3811-2ee5-42d4-bd84-201e64e54b58 with Priority: HIGHEST for action port [ 905.436327] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_rules [ 905.439662] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 905.439662] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b3f3811-2ee5-42d4-bd84-201e64e54b58 with Priority: HIGHEST for action port [ 905.439662] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.439662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.439662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.439662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.439662] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.440092] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.441052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.441052] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2b3f3811-2ee5-42d4-bd84-201e64e54b58 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.441052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.441052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.441052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.441052] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2b3f3811-2ee5-42d4-bd84-201e64e54b58',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.781851] env[70287]: INFO networking_nsxv3.common.synchronization [req-bf5baef5-dfaa-4b03-a33a-469580c11a38 req-bc2af606-42d9-4d4f-9bd8-387237427830 tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 905.784761] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 905.784761] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.784761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.784761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.784761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.784761] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.784761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.784761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.784761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.784761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.784761] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.944093] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2b3f3811-2ee5-42d4-bd84-201e64e54b58 with status ACTIVE [ 905.944093] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.944093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.944525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.944788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.944937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.945316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.945316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.945316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.945470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.945560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.945842] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.945842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.946026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.946026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.946098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.946202] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2b3f3811-2ee5-42d4-bd84-201e64e54b58 is going to be updated. [ 905.948072] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.948072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.966872] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.967509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.967736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.968227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.968475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.968830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2b3f3811-2ee5-42d4-bd84-201e64e54b58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.137704] env[70287]: INFO networking_nsxv3.common.synchronization [req-07feabba-0fcd-45af-8418-b497de4c3c83 req-1af27d2c-3203-4771-9711-a4283c9564ca tempest-ServerPasswordTestJSON-2110653874 tempest-ServerPasswordTestJSON-2110653874-project-member] Enqueued Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_members [ 906.138617] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_members [ 906.139105] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e14022e-50e8-464a-97d9-95650f41cb7b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.139395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.139395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.139769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.140009] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.140206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.140311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.140602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.140873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.140873] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.173357] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 906.173357] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 deletion is rescheduled due to dependency. [ 906.173357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.173357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.173357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.173357] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.173357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.173793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.173793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.173793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.174132] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.287299] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.452787] env[70287]: INFO networking_nsxv3.common.synchronization [req-322ae975-05b2-46f4-9a74-ae86a48007c0 req-8653f949-82b1-4eaa-912e-827cbd44da97 tempest-ListServersNegativeTestJSON-1716050224 tempest-ListServersNegativeTestJSON-1716050224-project-member] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 906.453709] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 906.456598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.460030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.541082] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-257 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.541322] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-257" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.541452] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-257" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.545228] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-257" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.545580] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.545881] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.545881] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.546160] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.546314] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.546528] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.546668] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.546836] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.546925] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.547052] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 906.547169] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.547309] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.566549] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.566721] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 906.567982] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.567982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-257" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.567982] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-801719fc-e3a5-496c-aa55-4bb7825ab897 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.567982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.567982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.569105] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.569105] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('801719fc-e3a5-496c-aa55-4bb7825ab897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.643703] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.643904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.643970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.644203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.644295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.644485] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.644604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.644682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.644868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.644991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.645112] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e14022e-50e8-464a-97d9-95650f41cb7b already deleted. [ 906.645202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.676216] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.702751] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 906.703365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.703365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.703473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.703639] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.703757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.703824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.703976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.704074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.704159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.704350] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.704431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.704464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.704606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.704746] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.704908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.704908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.706146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.706251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.706344] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.706438] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.707272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.707462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.707642] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.707712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.707811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.708071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.708071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.710209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.790029] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.859584] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 in Status: SUCCESS [ 906.860143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.860143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.860317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.860511] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.860665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.860862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.860973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.862744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.862744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.862744] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.070521] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.070772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.070871] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.071184] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.071342] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.071553] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 801719fc-e3a5-496c-aa55-4bb7825ab897 not found, creating... [ 907.071753] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.071909] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.072041] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.072272] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.072418] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.072695] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.072873] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.072992] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.073240] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.073387] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.073527] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 801719fc-e3a5-496c-aa55-4bb7825ab897 is going to be created. [ 907.090976] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.091309] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.091471] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.091742] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.091974] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.092221] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.181774] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.214011] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00cd6f54-b66d-4d65-84a8-02e8042ea31d: rpc.has_security_group_logging(os_id): False [ 907.215155] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.236062] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.236327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.236429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.236600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.236706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.236975] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.237137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.237211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.237375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.237452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.237636] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.237736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.237788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.237929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.237994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.238188] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.238276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.238337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.238475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.238549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.238633] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be created. [ 907.291974] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.292206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.292287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.292533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.292643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.292767] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 907.310988] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.311247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.311356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.311669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.311938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.323574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 907.328198] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.328198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.328198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.328410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.328513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.338704] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 907.363653] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.684529] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.684848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.684848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.685026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.685124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.685252] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 907.711112] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.711388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.711525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.711842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.712071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.717863] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.720156] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 907.844940] env[70287]: INFO networking_nsxv3.common.synchronization [req-07feabba-0fcd-45af-8418-b497de4c3c83 req-577e35d7-9107-4af7-a41e-31be7da59211 service nova] Enqueued Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_rules [ 907.844940] env[70287]: INFO networking_nsxv3.common.synchronization [req-07feabba-0fcd-45af-8418-b497de4c3c83 req-577e35d7-9107-4af7-a41e-31be7da59211 service nova] Enqueued Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_members [ 907.844940] env[70287]: INFO networking_nsxv3.common.synchronization [req-07feabba-0fcd-45af-8418-b497de4c3c83 req-577e35d7-9107-4af7-a41e-31be7da59211 service nova] Enqueued Resource ID: 801719fc-e3a5-496c-aa55-4bb7825ab897 with Priority: HIGHEST for action port [ 907.844940] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_rules [ 907.844940] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_members [ 907.844940] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 801719fc-e3a5-496c-aa55-4bb7825ab897 with Priority: HIGHEST for action port [ 907.845930] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6e14022e-50e8-464a-97d9-95650f41cb7b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.847029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.847029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.847029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.847029] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.847963] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e14022e-50e8-464a-97d9-95650f41cb7b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.848228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.848333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.848538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.852253] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.852364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.852452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.853014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.853014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.853014] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.854471] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-801719fc-e3a5-496c-aa55-4bb7825ab897 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.854573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.854658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.854903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.855058] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('801719fc-e3a5-496c-aa55-4bb7825ab897',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.866295] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e412cd2-d48e-4d56-bb8c-6bca0756dff0: rpc.has_security_group_logging(os_id): False [ 907.883103] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.883264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.883373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.883598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.883689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.883932] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.884058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.884126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.884294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.884521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.884631] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 is going to be created. [ 907.951023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.951023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.951023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.951023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.951023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.959503] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 in Status: IN_PROGRESS for 2s [ 908.221303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.221720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.221720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.221720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.221926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.221977] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 908.250382] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.250580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.250676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.250885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.251086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.261682] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 908.357550] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.358609] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e14022e-50e8-464a-97d9-95650f41cb7b taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.358609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.358965] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 801719fc-e3a5-496c-aa55-4bb7825ab897 with status ACTIVE [ 908.359143] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.359254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.359377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.359530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.359620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.359788] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.359885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.359974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.360123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.360237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.360738] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.360738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.360738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.360738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.360738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.360974] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 801719fc-e3a5-496c-aa55-4bb7825ab897 is going to be updated. [ 908.383545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.383545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.383545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.383545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.383545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.383545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-801719fc-e3a5-496c-aa55-4bb7825ab897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.860269] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.336220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 909.336488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.336929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.337302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.337462] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.349304] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 909.349560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.363153] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.363319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.363398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.363588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.363682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.363755] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e14022e-50e8-464a-97d9-95650f41cb7b is going to be created. [ 909.383965] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.384137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.384219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.384398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.384544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.404935] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e14022e-50e8-464a-97d9-95650f41cb7b in Status: UNINITIALIZED for 2s [ 909.729406] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 909.729625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.729837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.730080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.730411] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.730545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.730646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.730854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.730992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.731058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.731273] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.841316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.841492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.973189] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 in Status: SUCCESS [ 909.973546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.233964] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.234141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.234231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.234450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.234623] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.234735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.234789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.234919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.235035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.235134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.235290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.235397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.236342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.236342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.236342] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.236342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.236342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.236342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.236342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.236622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.236622] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.277026] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 910.277026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.277026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.277026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.277026] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.277026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.277026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.277026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.278578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.278578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.278578] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.740185] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c8498fc-c714-4100-81f9-c85ac268aab7: rpc.has_security_group_logging(os_id): False [ 910.757489] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.757648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.757693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.757942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.758054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.758260] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.758364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.758444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.758617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.758697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.758904] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.759029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.759105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.759251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.759326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.759531] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.759627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.759698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.759838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.759911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.759996] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 910.780957] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.781252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.781348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.781608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.781823] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.781951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.782048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.782629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.782767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.783010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.783240] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.783371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.783455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.783663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.783894] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.784055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.784159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.784362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.784485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.784598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.784696] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.849142] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.849142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.849142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.849142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.849335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.863213] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 911.287366] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00cd6f54-b66d-4d65-84a8-02e8042ea31d: rpc.has_security_group_logging(os_id): False [ 911.312328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.312328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.312328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.312678] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.312678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.312678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.312869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.312995] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.313342] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.313611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.313757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.313985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.314155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.315030] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 911.393856] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.394090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.394171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.394381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.394525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.418163] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e14022e-50e8-464a-97d9-95650f41cb7b in Status: SUCCESS [ 911.418163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.418163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.418163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.418163] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.418468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.418468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.418468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.418615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.418615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.418703] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.421418] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 911.921676] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e14022e-50e8-464a-97d9-95650f41cb7b taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.921909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.921909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.922647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.922647] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.922647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.922647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.922806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.922806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.922892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.923019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e14022e-50e8-464a-97d9-95650f41cb7b taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.923992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.924078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.924248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.924401] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.924659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.924659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.924768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.924868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.925097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.926949] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.430940] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6e14022e-50e8-464a-97d9-95650f41cb7b: rpc.has_security_group_logging(os_id): False [ 912.448673] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.448823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.449410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.449410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.449410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.449585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.449585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.449672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.449829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.449911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.450165] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.450268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.450324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.450474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.450550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.451785] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.451785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.451785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.451785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.451785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.451785] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6e14022e-50e8-464a-97d9-95650f41cb7b is going to be created. [ 912.502755] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.502945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.503105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.503351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.503549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.513284] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e14022e-50e8-464a-97d9-95650f41cb7b in Status: IN_PROGRESS for 2s [ 912.846912] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 912.847043] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 912.880013] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 912.880115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.436383] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 913.436383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.436383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.436383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.436383] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.841874] env[70287]: INFO networking_nsxv3.common.synchronization [req-ad062ad3-b11a-43cd-959a-a842a52c5493 req-d77727be-41d9-4aa5-89cf-e8fd67c043f3 tempest-ServersNegativeTestJSON-782058407 tempest-ServersNegativeTestJSON-782058407-project-member] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 913.841874] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 913.841874] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.841874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.841874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.844695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.846316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.846316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.846316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.846316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.846316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.846316] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.939724] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.939923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.940036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.940280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.940502] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.940612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.940679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.940929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.941087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.941220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.941336] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.944264] env[70287]: INFO networking_nsxv3.common.synchronization [req-8c2d9806-b51f-4950-9c45-53658940129d req-870cc3e2-bdf1-4457-a5bb-ec651e6aa0f7 tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 913.945092] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 913.945566] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.945717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.945787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.946030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.946215] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.946322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.946456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.946581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.946721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.946982] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.257515] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-709 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.257769] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.257907] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.258243] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.258600] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.258713] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.259167] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.259433] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.259594] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.260547] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.260630] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 914.260727] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 914.260851] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 914.260984] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 914.261121] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 914.261458] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 914.280599] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 914.280778] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 914.280924] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 914.281126] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.281442] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-751fd7f6-891d-415d-b8c8-ae97fa413536 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.281621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.281745] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.282093] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.282228] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('751fd7f6-891d-415d-b8c8-ae97fa413536',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.350241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.350241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.350241] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe already deleted. [ 914.350241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.447720] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.451019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.451019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.451019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.451019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.451912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.451912] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.452927] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.453372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.453539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.453777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.453999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.454352] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.454591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.454750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.456019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.456019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.456019] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 914.480216] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.480501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.480698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.480983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.481243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.488888] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 914.523082] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6e14022e-50e8-464a-97d9-95650f41cb7b in Status: SUCCESS [ 914.523333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.788225] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.788483] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.788660] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.788971] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.791039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.791039] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 751fd7f6-891d-415d-b8c8-ae97fa413536 not found, creating... [ 914.791039] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.791039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.791039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.791039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.791039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.791039] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.791690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.792332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.792332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.792459] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.792646] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 is going to be created. [ 914.812233] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.812494] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.812628] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.812950] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.813246] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.813495] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.958979] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00cd6f54-b66d-4d65-84a8-02e8042ea31d: rpc.has_security_group_logging(os_id): False [ 914.984296] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.984296] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.984296] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.984296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.985200] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.985200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.985200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.985200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.985200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.985200] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 915.058949] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.059160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.059160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.059757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.059757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.072159] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 915.926262] env[70287]: INFO networking_nsxv3.common.synchronization [req-ad062ad3-b11a-43cd-959a-a842a52c5493 req-bbb5f66f-12c3-4be0-9ccb-1b5c62e696b5 service nova] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_rules [ 915.926896] env[70287]: INFO networking_nsxv3.common.synchronization [req-ad062ad3-b11a-43cd-959a-a842a52c5493 req-bbb5f66f-12c3-4be0-9ccb-1b5c62e696b5 service nova] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 915.927197] env[70287]: INFO networking_nsxv3.common.synchronization [req-ad062ad3-b11a-43cd-959a-a842a52c5493 req-bbb5f66f-12c3-4be0-9ccb-1b5c62e696b5 service nova] Enqueued Resource ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 with Priority: HIGHEST for action port [ 915.928275] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_rules [ 915.930561] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 915.930561] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 with Priority: HIGHEST for action port [ 915.930561] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.930561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.930561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.930561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.930561] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.934020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.934020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.934020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.934020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.934888] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.934888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.934888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.934888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.934888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.935525] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.936162] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-751fd7f6-891d-415d-b8c8-ae97fa413536 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.936575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.936575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.937520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.937520] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('751fd7f6-891d-415d-b8c8-ae97fa413536',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.439802] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.441230] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.441362] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.441494] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 751fd7f6-891d-415d-b8c8-ae97fa413536 with status ACTIVE [ 916.441649] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.441755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.441847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.442048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.442268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.442359] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.442465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.442465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.442844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.442844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.443062] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.443214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.443214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.443322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.443371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.443445] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 is going to be updated. [ 916.466828] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.467253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.467253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.467377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.467481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.467652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.502744] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 916.502984] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 deletion is rescheduled due to dependency. [ 916.503136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.946122] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.087205] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 917.089105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.448540] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.448816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.448816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.448999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.449115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.449222] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be created. [ 917.471903] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.472071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.472134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.472388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.472624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.481816] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: UNINITIALIZED for 2s [ 918.559592] env[70287]: INFO networking_nsxv3.common.synchronization [req-1b38b1fb-a651-483b-88f6-cd5fe261d1ba req-e947dc3b-dc2e-4036-8089-1b0f2fd6ea88 tempest-ImagesOneServerNegativeTestJSON-354430768 tempest-ImagesOneServerNegativeTestJSON-354430768-project-member] Enqueued Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 918.561148] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 with Priority: HIGHEST for action security_group_members [ 918.561758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c8498fc-c714-4100-81f9-c85ac268aab7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.561758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.561758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.561928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.562014] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.562122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.562177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.562323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.562407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.562499] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c8498fc-c714-4100-81f9-c85ac268aab7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.920514] env[70287]: INFO networking_nsxv3.common.synchronization [req-dadbf891-57fd-4a5a-a3ef-98b5923be4d1 req-32c4831b-6b0b-45b2-ba77-5d23b6ef1780 tempest-ServerPasswordTestJSON-2110653874 tempest-ServerPasswordTestJSON-2110653874-project-member] Enqueued Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_members [ 918.921310] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e14022e-50e8-464a-97d9-95650f41cb7b with Priority: HIGHEST for action security_group_members [ 918.921792] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e14022e-50e8-464a-97d9-95650f41cb7b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.921951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.922062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.922307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.922509] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.922635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.922718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.922904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.923034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.923145] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e14022e-50e8-464a-97d9-95650f41cb7b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.065050] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.068241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.068241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.068241] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 is going to be updated. [ 919.094326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.094548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.094548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.094752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.094889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.103117] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: IN_PROGRESS for 2s [ 919.425915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.426334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.426451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.426770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.426903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.427223] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.427378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.427469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.427707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.427817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.427935] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e14022e-50e8-464a-97d9-95650f41cb7b is going to be updated. [ 919.454145] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.454361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.454361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.454618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.454759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.463593] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e14022e-50e8-464a-97d9-95650f41cb7b in Status: IN_PROGRESS for 2s [ 919.491658] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 919.491934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.492087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.492555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.492777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.492915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.492988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.493753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.493753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.493753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.493753] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.996054] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.996944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.997090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.997368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.997612] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.997755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.997837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.998103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.998202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.998317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.998562] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.998702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.998754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.998919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.999086] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.999185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.999238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.999381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.999459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.999539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.999628] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.502022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe: rpc.has_security_group_logging(os_id): False [ 920.522500] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.522688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.522817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.523099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.523313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.523429] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.523551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.523633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.523784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.523885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.524196] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.524342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.524428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.524535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.524656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.524890] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.524998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.525100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.525292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.525393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.525495] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be created. [ 920.580246] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.580439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.580496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.582051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.582051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.590404] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 921.117687] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 in Status: SUCCESS [ 921.118086] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c8498fc-c714-4100-81f9-c85ac268aab7 deletion is rescheduled due to dependency. [ 921.118182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c8498fc-c714-4100-81f9-c85ac268aab7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.474119] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e14022e-50e8-464a-97d9-95650f41cb7b in Status: SUCCESS [ 921.474304] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e14022e-50e8-464a-97d9-95650f41cb7b deletion is rescheduled due to dependency. [ 921.474414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e14022e-50e8-464a-97d9-95650f41cb7b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.956913] env[70287]: INFO networking_nsxv3.common.synchronization [req-208887fb-0b55-4acc-8495-ab9e625259ba req-5c2f341e-503e-4173-b4d3-99a63e896151 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 921.957345] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 921.961682] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.961682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.961682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.961682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.961682] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.961682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.962019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.962019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.962019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.962127] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.053384] env[70287]: INFO networking_nsxv3.common.synchronization [req-46e92c9d-e066-4193-860e-b6efd1f04a90 req-10833649-b2a0-4d35-a2ae-37c52060cdaf tempest-MigrationsAdminTest-1148431189 tempest-MigrationsAdminTest-1148431189-project-member] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 922.053911] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGHEST for action security_group_members [ 922.054224] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.054938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.054938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.054938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.054938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.054938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.054938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.055236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.055277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.055377] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.454030] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.454376] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.454517] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.454819] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.455086] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.455325] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.455535] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.455764] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.455917] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.456175] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.456305] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.456421] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.456534] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.456662] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 922.456761] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.456898] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.472157] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.484203] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.484390] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 922.484530] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.484705] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.485034] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-d43a2340-cdd3-4cee-afce-98c819e57989 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.485264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.485454] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.485763] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.485945] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43a2340-cdd3-4cee-afce-98c819e57989',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.557102] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.557271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.557345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.557561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.577218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.577497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.577583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.577635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.577827] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.577907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.577996] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be updated. [ 922.600951] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 922.601197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.605776] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.605946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.605995] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.606237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.606382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.614603] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: IN_PROGRESS for 2s [ 922.974650] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.987792] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.988054] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.988162] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.988439] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.988593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.988749] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port d43a2340-cdd3-4cee-afce-98c819e57989 not found, creating... [ 922.989085] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.989250] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.989372] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.989596] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.989736] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.990027] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.990188] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.990314] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.990524] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.990679] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.990797] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: d43a2340-cdd3-4cee-afce-98c819e57989 is going to be created. [ 923.010744] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.010950] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.011098] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.011374] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.011645] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.011875] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.477698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.478066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.478218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.478543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.478700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.478846] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 923.504573] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.504770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.504869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.505180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.505342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.512797] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 923.786966] env[70287]: INFO networking_nsxv3.common.synchronization [req-208887fb-0b55-4acc-8495-ab9e625259ba req-0fe12a23-828e-4e1f-99b4-70421cc54219 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 923.787178] env[70287]: INFO networking_nsxv3.common.synchronization [req-208887fb-0b55-4acc-8495-ab9e625259ba req-0fe12a23-828e-4e1f-99b4-70421cc54219 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 923.787324] env[70287]: INFO networking_nsxv3.common.synchronization [req-208887fb-0b55-4acc-8495-ab9e625259ba req-0fe12a23-828e-4e1f-99b4-70421cc54219 service nova] Enqueued Resource ID: d43a2340-cdd3-4cee-afce-98c819e57989 with Priority: HIGHEST for action port [ 923.787870] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 923.788124] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 923.788124] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d43a2340-cdd3-4cee-afce-98c819e57989 with Priority: HIGHEST for action port [ 923.788388] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.788548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.788658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.788929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.789057] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.790577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.790577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.790577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d43a2340-cdd3-4cee-afce-98c819e57989 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.790980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.790980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.791067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.791112] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d43a2340-cdd3-4cee-afce-98c819e57989',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.293031] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.293175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.295731] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d43a2340-cdd3-4cee-afce-98c819e57989 with status ACTIVE [ 924.295782] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.295874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.295951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.296198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.296284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.296459] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.296559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.296636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.296769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.296864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.297090] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.297207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.297266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.297474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.297562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.297632] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d43a2340-cdd3-4cee-afce-98c819e57989 is going to be updated. [ 924.318732] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.318732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.318732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.318966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.318966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.319159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d43a2340-cdd3-4cee-afce-98c819e57989" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.623919] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 in Status: SUCCESS [ 924.624189] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 deletion is rescheduled due to dependency. [ 924.624240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.523162] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 925.523401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.523584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.523800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.523985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.524120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.524594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.524594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.524594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.524594] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.026699] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.529481] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.971413] env[70287]: INFO networking_nsxv3.common.synchronization [req-dd3a686e-8d14-4274-9475-629db9480377 req-995b0d4f-56c0-43e5-938f-9c98bb5ccb17 tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 926.972012] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 926.973290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.973419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.973584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.973857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.974113] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.974280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.974383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.974638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.974772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.974927] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.032069] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.032444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.032518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.033022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.033205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.033291] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 927.062727] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.062844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.062844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.064511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.064511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.071667] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 927.478176] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.478270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.478332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.478568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.478662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.478861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.478963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.479103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.479190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.479268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.479356] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 927.504066] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.504197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.504258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.504465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.504606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.512441] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 929.081678] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 929.082115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.082115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.082302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.082494] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.082611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.082686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.082872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.082935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.083009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.083145] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.363458] env[70287]: INFO networking_nsxv3.common.synchronization [req-ec8642cc-247b-43fe-8424-23396fa78e3c req-771e6e6d-200b-49f1-97b9-da4700584b12 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 929.364142] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 929.364477] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.364603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.364662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.364918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.365088] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.365207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.365275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.365452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.365538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.365685] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.522152] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 929.522152] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 929.522557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.588554] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.588722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.588795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.589034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.589203] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.589310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.589375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.590173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.590235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.590320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.590482] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.590586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.590647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.590838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.591104] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.591242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.591308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.591455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.591533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.591615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.591706] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.769310] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.769310] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.769488] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.769770] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.770733] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.770800] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.772531] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.772531] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.772531] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.772531] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.772531] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 929.772531] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 929.772531] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 929.772531] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 929.772531] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 929.772531] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 929.795638] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 929.795829] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 929.798017] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 929.798017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.798017] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-df314e8a-2d9e-45e4-aec8-92de1d8583ac taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.798017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.798017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.798017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.798017] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df314e8a-2d9e-45e4-aec8-92de1d8583ac',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.867359] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.867580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.867654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.867868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.867958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.868172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.868271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.868333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.868476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.868551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.868637] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 already deleted. [ 929.868716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.094144] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 930.112020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.112201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.112274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.112496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.112588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.112783] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.112875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.112932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.113112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.113185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.113369] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.113464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.113533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.113730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.113811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.114015] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.114114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.114174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.114316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.114388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.114471] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 930.169951] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.170154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.170237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.170499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.170667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.188628] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 930.300285] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.300558] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.300720] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.301017] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.301181] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.301357] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port df314e8a-2d9e-45e4-aec8-92de1d8583ac not found, creating... [ 930.301638] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.301817] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.301950] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.302202] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.302348] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.303411] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.303411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.303411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.303411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.303634] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.303634] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: df314e8a-2d9e-45e4-aec8-92de1d8583ac is going to be created. [ 930.325761] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.325986] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.326136] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.326425] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.326659] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.326902] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.100352] env[70287]: INFO networking_nsxv3.common.synchronization [req-ec8642cc-247b-43fe-8424-23396fa78e3c req-1cc811ab-77fb-4ff7-9a8b-280248fdfc75 service nova] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 931.100775] env[70287]: INFO networking_nsxv3.common.synchronization [req-ec8642cc-247b-43fe-8424-23396fa78e3c req-1cc811ab-77fb-4ff7-9a8b-280248fdfc75 service nova] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 931.100775] env[70287]: INFO networking_nsxv3.common.synchronization [req-ec8642cc-247b-43fe-8424-23396fa78e3c req-1cc811ab-77fb-4ff7-9a8b-280248fdfc75 service nova] Enqueued Resource ID: df314e8a-2d9e-45e4-aec8-92de1d8583ac with Priority: HIGHEST for action port [ 931.101361] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 931.101537] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 931.101634] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df314e8a-2d9e-45e4-aec8-92de1d8583ac with Priority: HIGHEST for action port [ 931.101951] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.102138] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.102258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.102527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.102635] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.103686] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.103843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.103918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.104227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.104342] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.104504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.104620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.104825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.104911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.105018] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.105950] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-df314e8a-2d9e-45e4-aec8-92de1d8583ac taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.106107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.106310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.106450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.106450] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df314e8a-2d9e-45e4-aec8-92de1d8583ac',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.608426] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.609066] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.609190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.611281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df314e8a-2d9e-45e4-aec8-92de1d8583ac with status ACTIVE [ 931.611481] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.611590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.611590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.611883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.611883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.612068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.612154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.612201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.612414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.612414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.612600] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.612714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.612849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.612933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.612999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.613144] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df314e8a-2d9e-45e4-aec8-92de1d8583ac is going to be updated. [ 931.632284] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.632459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.632554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.632782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.632926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.633104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df314e8a-2d9e-45e4-aec8-92de1d8583ac" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.112827] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.205859] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 932.206152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.617569] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.620144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.620294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.620469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.620559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.620663] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be created. [ 932.643378] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.643467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.643505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.644241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.644241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.653187] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: UNINITIALIZED for 2s [ 934.668309] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.668309] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.668309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.668309] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.170500] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.364777] env[70287]: INFO networking_nsxv3.common.synchronization [req-0bed0a40-ead6-4652-bfe2-e08f1f09dc4b req-c07dd8db-dc20-4647-949f-16e985ca3169 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 935.367832] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 935.368266] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.371785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.371954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.372219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.372419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.372541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.372606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.372811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.372911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.373028] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.439029] env[70287]: INFO networking_nsxv3.common.synchronization [req-71c17be5-7b24-4172-887c-a12414aa176c req-5de95de0-ed27-4c42-860f-7ff50a8357f9 tempest-ServerTagsTestJSON-889025552 tempest-ServerTagsTestJSON-889025552-project-member] Enqueued Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_members [ 935.439029] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_members [ 935.439029] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.439381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.439381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.439520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.440505] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.440505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.440505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.440505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.440505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.440505] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.672697] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521389fe-7ad3-45db-944a-1438ff593c45: rpc.has_security_group_logging(os_id): False [ 935.689951] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.690129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.690210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.690420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.690528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.690782] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.690881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.690936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.691105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.691195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.691283] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be created. [ 935.751180] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.751408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.751508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.751789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.752085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.761976] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 2s [ 935.805177] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-534 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.805408] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-534" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.805538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-534" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.805899] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-534" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.806242] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.806473] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.806606] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.806833] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.806982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.807370] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.807493] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 935.807602] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 935.807733] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 935.807847] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 935.807956] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 935.808111] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 935.829378] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 935.829626] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 935.829705] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 935.829902] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-534" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.830251] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-7962c190-8637-4f0a-8bbd-b392b3d6ff78 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.830430] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.830663] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.830997] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.831173] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7962c190-8637-4f0a-8bbd-b392b3d6ff78',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.878378] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.950286] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.950286] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.950286] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4192632d-6c01-4f54-972c-1e52156ebf12 already deleted. [ 935.950286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.335021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.335021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.335021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.335021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.335021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.335021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 7962c190-8637-4f0a-8bbd-b392b3d6ff78 not found, creating... [ 936.335380] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.335558] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.335690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.335935] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.336096] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.336508] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.336768] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.336900] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.337152] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.337323] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.337480] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 7962c190-8637-4f0a-8bbd-b392b3d6ff78 is going to be created. [ 936.358312] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.358528] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.358685] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.359026] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.363022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.363022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.380088] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.882306] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.882889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.882964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.883187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.883299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.883375] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 936.912017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.912017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.912017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.912017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.912017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.920483] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 937.057920] env[70287]: INFO networking_nsxv3.common.synchronization [req-71c17be5-7b24-4172-887c-a12414aa176c req-7bf54ef3-2bf7-4960-ac52-fe791168c714 service nova] Enqueued Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_rules [ 937.057920] env[70287]: INFO networking_nsxv3.common.synchronization [req-71c17be5-7b24-4172-887c-a12414aa176c req-7bf54ef3-2bf7-4960-ac52-fe791168c714 service nova] Enqueued Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_members [ 937.057920] env[70287]: INFO networking_nsxv3.common.synchronization [req-71c17be5-7b24-4172-887c-a12414aa176c req-7bf54ef3-2bf7-4960-ac52-fe791168c714 service nova] Enqueued Resource ID: 7962c190-8637-4f0a-8bbd-b392b3d6ff78 with Priority: HIGHEST for action port [ 937.057920] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_rules [ 937.057920] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_members [ 937.057920] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7962c190-8637-4f0a-8bbd-b392b3d6ff78 with Priority: HIGHEST for action port [ 937.057920] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.057920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.058710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.058800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.058884] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.061757] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.062263] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.062345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.062541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.062897] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.062897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.062897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.063062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.063148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.063245] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.068073] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7962c190-8637-4f0a-8bbd-b392b3d6ff78 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.068073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.068073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.068073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.068073] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7962c190-8637-4f0a-8bbd-b392b3d6ff78',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.567369] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.567369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.567513] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.568467] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7962c190-8637-4f0a-8bbd-b392b3d6ff78 with status ACTIVE [ 937.568603] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.569953] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.569953] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.569953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.570428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.570467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.570888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.570888] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7962c190-8637-4f0a-8bbd-b392b3d6ff78 is going to be updated. [ 937.603024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.603024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.603024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.603024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.603024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.603407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7962c190-8637-4f0a-8bbd-b392b3d6ff78" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.775574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 937.775908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.073803] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.578566] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.578566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.578566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.578566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.578566] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.578566] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4192632d-6c01-4f54-972c-1e52156ebf12 is going to be created. [ 938.601435] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.602092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.602305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.602732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.604019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.615121] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4192632d-6c01-4f54-972c-1e52156ebf12 in Status: UNINITIALIZED for 2s [ 938.932144] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 938.932207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.512250] env[70287]: INFO networking_nsxv3.common.synchronization [req-68f8523b-8f99-4caa-9ab6-914f8999e598 req-52c01907-c3f7-4de5-a32b-bc271e998dcc tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 939.512250] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 939.512250] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.512250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.512250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.512250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.513328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.514073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.514404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.515060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.515458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.515680] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.019547] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.521667] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.625679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4192632d-6c01-4f54-972c-1e52156ebf12 in Status: SUCCESS [ 940.626281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.626526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.626791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.627195] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.627381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.627478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.627687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.627815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.627955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.628693] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.027023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.027023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.027023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.027023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.027023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.027023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 941.053948] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.054478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.054478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.054963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.055178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.064240] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 941.132159] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.132805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.132924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.133143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.133342] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.133453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.133548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.133714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.133805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.133898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.134068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.134176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.134230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.134892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.134892] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.134892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.134892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.134892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.134892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.135209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.135209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.637692] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4192632d-6c01-4f54-972c-1e52156ebf12: rpc.has_security_group_logging(os_id): False [ 941.654693] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.654894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.654968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.655229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.656183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.656183] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.656183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.656183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.656183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.656183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.657586] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.657586] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.657586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.657586] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4192632d-6c01-4f54-972c-1e52156ebf12 is going to be created. [ 941.739739] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.739920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.739977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.740206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.740412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.750987] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4192632d-6c01-4f54-972c-1e52156ebf12 in Status: IN_PROGRESS for 2s [ 942.087083] env[70287]: INFO networking_nsxv3.common.synchronization [req-06c571f7-5c2d-4529-bdb6-35221584ff60 req-fbd8c60e-72f0-4f82-8ed4-60b0523f3ecc tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 942.087083] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 942.087353] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.087353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.087353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.087628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.087711] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.087814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.088018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.088100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.088154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.088520] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.478184] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.478388] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.478524] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.478814] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.479092] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.479253] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.479372] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.479593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.479744] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.480011] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.482124] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.482124] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.482124] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.482124] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 942.482124] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.482124] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.501077] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.501307] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 942.501454] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.502467] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.502760] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-52cdc9ef-0f16-44ae-bb8b-66570325f10f taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.502956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.503037] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.503474] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.503629] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cdc9ef-0f16-44ae-bb8b-66570325f10f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.591153] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.594545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.594545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.594545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.594545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.594545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.594545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.594545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.595036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.595036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.595036] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 942.618614] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.618831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.618831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.619095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.619612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.629595] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 942.961675] env[70287]: INFO networking_nsxv3.common.synchronization [None req-39b2e21a-4d16-4cd6-8049-d3808c4e0315 None None] Enqueued Resource ID: 3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731 with Priority: HIGHEST for action port [ 942.962276] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731 with Priority: HIGHEST for action port [ 942.962596] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.962751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.962813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.966018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.966018] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.009642] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.009642] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 52cdc9ef-0f16-44ae-bb8b-66570325f10f not found, creating... [ 943.009642] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.009642] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.010386] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.010386] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.011058] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.011475] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.011999] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.012182] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 52cdc9ef-0f16-44ae-bb8b-66570325f10f is going to be created. [ 943.032516] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.033474] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.033828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.034279] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.034840] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.035639] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.074296] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 943.074560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.352303] env[70287]: INFO networking_nsxv3.common.synchronization [req-dd722e13-d35e-4a0d-8b48-d07bd9878bb4 req-c01851be-0618-4980-b0fe-967370ce1560 tempest-ListServersNegativeTestJSON-1716050224 tempest-ListServersNegativeTestJSON-1716050224-project-member] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 943.352426] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 943.352682] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.352803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.352869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.354154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.354618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.354618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.354618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.354796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.354831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.354933] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.422542] env[70287]: INFO networking_nsxv3.common.synchronization [req-3c09b033-0f97-43ae-b8c1-c92596562f24 req-bc98916a-2775-406c-8b80-4258d11a1136 tempest-ListServersNegativeTestJSON-1716050224 tempest-ListServersNegativeTestJSON-1716050224-project-member] Enqueued Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 943.422707] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d with Priority: HIGHEST for action security_group_members [ 943.423163] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-00cd6f54-b66d-4d65-84a8-02e8042ea31d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.423258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.468637] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731 [ 943.468637] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.468637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.468637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.468637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.468637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.468936] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731 already deleted. [ 943.468936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d8b8cb1-ce7b-4fcc-80f7-88a6f6ea4731" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.769201] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4192632d-6c01-4f54-972c-1e52156ebf12 in Status: SUCCESS [ 943.769201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.851939] env[70287]: INFO networking_nsxv3.common.synchronization [req-06c571f7-5c2d-4529-bdb6-35221584ff60 req-1c715bc3-8866-4128-95c7-dcaae322ab0e service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 943.852141] env[70287]: INFO networking_nsxv3.common.synchronization [req-06c571f7-5c2d-4529-bdb6-35221584ff60 req-1c715bc3-8866-4128-95c7-dcaae322ab0e service nova] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 943.852283] env[70287]: INFO networking_nsxv3.common.synchronization [req-06c571f7-5c2d-4529-bdb6-35221584ff60 req-1c715bc3-8866-4128-95c7-dcaae322ab0e service nova] Enqueued Resource ID: 52cdc9ef-0f16-44ae-bb8b-66570325f10f with Priority: HIGHEST for action port [ 943.852518] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_rules [ 943.852639] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 943.852735] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52cdc9ef-0f16-44ae-bb8b-66570325f10f with Priority: HIGHEST for action port [ 943.853314] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.853450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.853506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.853807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.853807] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.854605] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.856131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.856131] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-52cdc9ef-0f16-44ae-bb8b-66570325f10f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.856131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.856131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.856131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.856131] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52cdc9ef-0f16-44ae-bb8b-66570325f10f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.021690] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.021690] env[70287]: INFO networking_nsxv3.common.synchronization [req-75f7d757-ce11-424f-a552-e3e3983a115f req-8fdb53c7-d699-4e96-bb45-4a4158d6b89c tempest-SecurityGroupRulesNegativeTestJSON-1048356918 tempest-SecurityGroupRulesNegativeTestJSON-1048356918-project-member] Enqueued Resource ID: 0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 with Priority: HIGHEST for action security_group_rules [ 944.021690] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 with Priority: HIGHEST for action security_group_rules [ 944.022234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.022370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.022441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.022702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.022816] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.274402] env[70287]: INFO networking_nsxv3.common.synchronization [req-21cd88e9-5d56-4d42-8f22-9164941ce4fa req-79922015-13ba-42d7-b31e-5020c1248f98 tempest-SecurityGroupRulesNegativeTestJSON-1048356918 tempest-SecurityGroupRulesNegativeTestJSON-1048356918-project-member] Enqueued Resource ID: 0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 with Priority: HIGHEST for action security_group_rules [ 944.275189] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 with Priority: HIGHEST for action security_group_rules [ 944.275574] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.275681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.518776] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.518910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.522599] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52cdc9ef-0f16-44ae-bb8b-66570325f10f with status ACTIVE [ 944.523172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.523379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.523445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.523647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.523746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.523932] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.524033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.524099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.524258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.524334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.524546] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.524621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.524669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.524806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.524917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.524965] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52cdc9ef-0f16-44ae-bb8b-66570325f10f is going to be updated. [ 944.529833] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.545546] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.545804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.545804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.545987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.546091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.546193] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 already deleted. [ 944.546674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.547100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.547293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.547380] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.550185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.550348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.550411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.550537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.550819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.550862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52cdc9ef-0f16-44ae-bb8b-66570325f10f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.642675] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 944.642675] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 deletion is rescheduled due to dependency. [ 944.642675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.642675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.642675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.642675] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.642675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.642675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.643029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.643029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.643029] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.031837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.031837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.031837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.031837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.031837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.031837] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 945.061035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.061035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.061035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.061449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.061449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.068676] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.069054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.069054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.069054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.069269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.069269] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13 already deleted. [ 945.069342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ef52f1c-ac6c-4109-8d02-3e7cf50eaa13" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.069961] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 945.092231] env[70287]: INFO networking_nsxv3.common.synchronization [None req-29cbe681-67bf-44c4-b513-ece52a2ee883 None None] Enqueued Resource ID: ecfb1def-b1ac-44ba-9a7f-8b0052db8346 with Priority: HIGHEST for action port [ 945.092231] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecfb1def-b1ac-44ba-9a7f-8b0052db8346 with Priority: HIGHEST for action port [ 945.092231] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecfb1def-b1ac-44ba-9a7f-8b0052db8346 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.092583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecfb1def-b1ac-44ba-9a7f-8b0052db8346" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.092583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecfb1def-b1ac-44ba-9a7f-8b0052db8346" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.092664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecfb1def-b1ac-44ba-9a7f-8b0052db8346" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.092704] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecfb1def-b1ac-44ba-9a7f-8b0052db8346',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.146671] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.594157] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ecfb1def-b1ac-44ba-9a7f-8b0052db8346 [ 945.594396] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.594529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.594599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.594821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.594910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.595016] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ecfb1def-b1ac-44ba-9a7f-8b0052db8346 already deleted. [ 945.595098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecfb1def-b1ac-44ba-9a7f-8b0052db8346" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.650143] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.153718] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.154074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.154074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.154312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.154312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.154312] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 946.180982] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.181141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.181208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.181490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.181588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.190399] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 947.079604] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 947.079998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.080890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.081086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.081347] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.081558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.081657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.081726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.081815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.081909] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00cd6f54-b66d-4d65-84a8-02e8042ea31d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.205863] env[70287]: INFO networking_nsxv3.common.synchronization [req-f8dc988d-78c4-4923-9c00-f617fafe2786 req-b3c0e9c4-ac36-43bb-99e6-c49c4f82d041 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_members [ 947.207502] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 with Priority: HIGHEST for action security_group_members [ 947.207626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.207936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.207936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.208158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.208325] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.208461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.208537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.208737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.208836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.208931] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6e412cd2-d48e-4d56-bb8c-6bca0756dff0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.591244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.591244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.591244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.591244] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d is going to be updated. [ 947.618641] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.618786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.618856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.619114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.619255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.633165] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: IN_PROGRESS for 2s [ 947.711335] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.711539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.711743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.711869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.711983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.712234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.712462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.712462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.712595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.712655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.712752] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 is going to be updated. [ 947.741982] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.742259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.742259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.742453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.742598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.754272] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 in Status: IN_PROGRESS for 2s [ 948.203112] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 948.203517] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.203832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.205686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.205686] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.205686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.205686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.205686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.205686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.205686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.205686] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.708921] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.708921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.708921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.708921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.708921] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.708921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.708921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.709261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.709261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.709261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.709418] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.709418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.709418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.709547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.709678] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.709769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.709826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.709960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.710043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.710122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.710209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.216259] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5344b0-d8f6-49cd-abc4-1a415b3aa399: rpc.has_security_group_logging(os_id): False [ 949.232979] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.235025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.235025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.235025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.235893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.236629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.236629] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.236629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.236629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.237161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.237455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.239066] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 949.296409] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.296543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.296594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.296838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.297614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.319487] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 949.644618] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d in Status: SUCCESS [ 949.644837] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00cd6f54-b66d-4d65-84a8-02e8042ea31d deletion is rescheduled due to dependency. [ 949.644950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00cd6f54-b66d-4d65-84a8-02e8042ea31d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.763962] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 in Status: SUCCESS [ 949.764234] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6e412cd2-d48e-4d56-bb8c-6bca0756dff0 deletion is rescheduled due to dependency. [ 949.764304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6e412cd2-d48e-4d56-bb8c-6bca0756dff0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.338342] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 951.338699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.386941] env[70287]: INFO networking_nsxv3.common.synchronization [req-9c95943a-9443-414a-bf0d-d19bdb081716 req-c6834000-e81c-44c6-9716-0b26c467a375 tempest-ServerTagsTestJSON-889025552 tempest-ServerTagsTestJSON-889025552-project-member] Enqueued Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_members [ 951.387563] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGHEST for action security_group_members [ 951.388496] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.388648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.388715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.388941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.389134] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.389249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.389313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.389480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.389576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.389680] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.893331] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.893525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.893686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.894251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.894251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.894251] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.894251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.894251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.894514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.894514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.894577] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4192632d-6c01-4f54-972c-1e52156ebf12 is going to be updated. [ 951.923207] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.923381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.923436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.923678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.923816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.933589] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4192632d-6c01-4f54-972c-1e52156ebf12 in Status: IN_PROGRESS for 2s [ 952.301435] env[70287]: INFO networking_nsxv3.common.synchronization [None req-1f83342d-f366-45e5-9977-d0aa256708ac None None] Enqueued Resource ID: b6e3310f-7c53-4690-a451-6de1f1c4ac9f with Priority: HIGHEST for action port [ 952.302353] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6e3310f-7c53-4690-a451-6de1f1c4ac9f with Priority: HIGHEST for action port [ 952.304240] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6e3310f-7c53-4690-a451-6de1f1c4ac9f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.304240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6e3310f-7c53-4690-a451-6de1f1c4ac9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.304240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6e3310f-7c53-4690-a451-6de1f1c4ac9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.306322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6e3310f-7c53-4690-a451-6de1f1c4ac9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.306322] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6e3310f-7c53-4690-a451-6de1f1c4ac9f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.809431] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6e3310f-7c53-4690-a451-6de1f1c4ac9f [ 952.809704] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.809812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.809906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.810185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.810280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.810388] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6e3310f-7c53-4690-a451-6de1f1c4ac9f already deleted. [ 952.810470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6e3310f-7c53-4690-a451-6de1f1c4ac9f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.943616] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4192632d-6c01-4f54-972c-1e52156ebf12 in Status: SUCCESS [ 953.944045] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4192632d-6c01-4f54-972c-1e52156ebf12 deletion is rescheduled due to dependency. [ 953.944045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.394280] env[70287]: INFO networking_nsxv3.common.synchronization [req-4286fa5b-c92a-4f6a-b600-5e8fa1c2cce7 req-2e23d34f-cf70-476c-8274-b7d9f2c589f5 tempest-ServersNegativeTestJSON-782058407 tempest-ServersNegativeTestJSON-782058407-project-member] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 954.394862] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 954.395182] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.395347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.395387] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.395600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.395758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.395863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.395923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.396579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.396676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.396782] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.798696] env[70287]: INFO networking_nsxv3.common.synchronization [None req-bfd995d6-ce24-4605-b950-4eabaad47d07 None None] Enqueued Resource ID: b8912d41-babc-46c9-9450-ff7b2c890880 with Priority: HIGHEST for action port [ 954.799660] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8912d41-babc-46c9-9450-ff7b2c890880 with Priority: HIGHEST for action port [ 954.802988] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8912d41-babc-46c9-9450-ff7b2c890880 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.802988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8912d41-babc-46c9-9450-ff7b2c890880" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.802988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8912d41-babc-46c9-9450-ff7b2c890880" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.802988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8912d41-babc-46c9-9450-ff7b2c890880" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.802988] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8912d41-babc-46c9-9450-ff7b2c890880',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.835028] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-709 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.835257] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.835386] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.835723] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.836016] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.837864] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.838014] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.838298] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.838619] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.838701] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.838806] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.838923] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.839063] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.839241] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 954.839362] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.839508] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.861102] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.861102] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 954.861102] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.861102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.861102] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.861102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.861102] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.861422] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.861422] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e87b27a2-23c3-40d9-958d-3f8879f2d3c4',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.902202] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.305489] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8912d41-babc-46c9-9450-ff7b2c890880 [ 955.305743] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.305871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.305936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.306283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.306398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.306577] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8912d41-babc-46c9-9450-ff7b2c890880 already deleted. [ 955.306650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8912d41-babc-46c9-9450-ff7b2c890880" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.364280] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.364753] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.364753] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.365118] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.365299] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.365557] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port e87b27a2-23c3-40d9-958d-3f8879f2d3c4 not found, creating... [ 955.365943] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.366136] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.366272] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.366588] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.366756] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.367064] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.367226] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.367344] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.367555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.367690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.367831] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: e87b27a2-23c3-40d9-958d-3f8879f2d3c4 is going to be created. [ 955.387338] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.387338] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.387338] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.387338] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.387677] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.387677] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.403405] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.906031] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.906031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.906031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.906282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.906381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.906497] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be updated. [ 955.936221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.936221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.936221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.936221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.936221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.945363] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 956.172561] env[70287]: INFO networking_nsxv3.common.synchronization [req-4286fa5b-c92a-4f6a-b600-5e8fa1c2cce7 req-cd03267a-4c76-4845-b48a-d23feede50af service nova] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_rules [ 956.172826] env[70287]: INFO networking_nsxv3.common.synchronization [req-4286fa5b-c92a-4f6a-b600-5e8fa1c2cce7 req-cd03267a-4c76-4845-b48a-d23feede50af service nova] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 956.172976] env[70287]: INFO networking_nsxv3.common.synchronization [req-4286fa5b-c92a-4f6a-b600-5e8fa1c2cce7 req-cd03267a-4c76-4845-b48a-d23feede50af service nova] Enqueued Resource ID: e87b27a2-23c3-40d9-958d-3f8879f2d3c4 with Priority: HIGHEST for action port [ 956.173243] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_rules [ 956.173377] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 956.173489] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e87b27a2-23c3-40d9-958d-3f8879f2d3c4 with Priority: HIGHEST for action port [ 956.174106] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.174230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.174297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.174499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.174582] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.175488] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.175617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.175794] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.175891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.175954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.176139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.176211] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e87b27a2-23c3-40d9-958d-3f8879f2d3c4',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.678575] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.678853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.678981] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e87b27a2-23c3-40d9-958d-3f8879f2d3c4 with status ACTIVE [ 956.679194] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.679256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.679327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.679657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.679767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.680060] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.680187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.680250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.680413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.680492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.680681] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.680773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.680832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.680972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.681059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.681143] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e87b27a2-23c3-40d9-958d-3f8879f2d3c4 is going to be updated. [ 956.700817] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.701015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.701072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.701500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.701500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.701631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e87b27a2-23c3-40d9-958d-3f8879f2d3c4" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.954206] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 957.954503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.954671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.954991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.955096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.955213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.955270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.955424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.955574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.955699] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.038931] env[70287]: INFO networking_nsxv3.common.synchronization [req-21e57936-6165-4892-92c5-f1a2a4322849 req-4f4b67ee-bb40-42a6-b11a-6c9ad6227ec4 tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 958.039799] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 958.041024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.041195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.041288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.041488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.041666] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.041773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.041852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.042019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.042114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.042222] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.460349] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.477787] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.478060] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.478231] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.478708] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.479121] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.479386] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.479593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.479928] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.480173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.480470] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.480759] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 958.480848] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 958.480929] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 958.481038] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 958.481157] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 958.481330] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 958.499069] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 958.499321] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 958.499499] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 958.499951] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.500193] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-0bf22cd1-36f8-47a6-b33f-a4955eef2052 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.500427] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.500583] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.500989] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.501854] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf22cd1-36f8-47a6-b33f-a4955eef2052',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.547755] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.547857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.548815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.548815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.548815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.548815] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.548815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.548815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.552089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.552089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.552089] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 958.571603] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.571603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.571603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.571988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.572177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.579512] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 958.963137] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.006503] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.006747] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.006905] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.007274] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.007472] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.007695] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 0bf22cd1-36f8-47a6-b33f-a4955eef2052 not found, creating... [ 959.008081] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.008298] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.008487] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.008782] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.008971] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.009331] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.009530] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.009675] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.009942] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.010103] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.010253] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 0bf22cd1-36f8-47a6-b33f-a4955eef2052 is going to be created. [ 959.028828] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.028977] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.029125] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.029510] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.029815] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.030227] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.465447] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.465590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.465677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.466415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.466415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.466415] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be updated. [ 959.492920] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.493112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.493166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.493376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.493519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.501379] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 959.825024] env[70287]: INFO networking_nsxv3.common.synchronization [req-21e57936-6165-4892-92c5-f1a2a4322849 req-2c6b4242-fdf2-4e4f-8742-1bbe3cea475d service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 959.825024] env[70287]: INFO networking_nsxv3.common.synchronization [req-21e57936-6165-4892-92c5-f1a2a4322849 req-2c6b4242-fdf2-4e4f-8742-1bbe3cea475d service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 959.825024] env[70287]: INFO networking_nsxv3.common.synchronization [req-21e57936-6165-4892-92c5-f1a2a4322849 req-2c6b4242-fdf2-4e4f-8742-1bbe3cea475d service nova] Enqueued Resource ID: 0bf22cd1-36f8-47a6-b33f-a4955eef2052 with Priority: HIGHEST for action port [ 959.825024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 959.825024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 959.825024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bf22cd1-36f8-47a6-b33f-a4955eef2052 with Priority: HIGHEST for action port [ 959.825024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.825024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.825024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.825732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.825903] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.827476] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.833348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.833348] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bf22cd1-36f8-47a6-b33f-a4955eef2052 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.833348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.833348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.833348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.833348] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bf22cd1-36f8-47a6-b33f-a4955eef2052',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.901941] env[70287]: INFO networking_nsxv3.common.synchronization [req-21e7c86d-2a0c-4c51-931e-7e62284743e5 req-ffcfe59c-c65b-4b7d-b86e-24b5b635cc28 tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_members [ 959.901941] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 306ade67-3f30-492d-a51d-d4eb542da01d with Priority: HIGHEST for action security_group_members [ 959.901941] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-306ade67-3f30-492d-a51d-d4eb542da01d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.901941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.901941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.908901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.908901] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.908901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.908901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.908901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.908901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.908901] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('306ade67-3f30-492d-a51d-d4eb542da01d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.333737] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.334398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.335114] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bf22cd1-36f8-47a6-b33f-a4955eef2052 with status ACTIVE [ 960.335289] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.335401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.335503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.336032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.336032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.336032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.336280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.336280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.336280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.336459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.336608] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.336704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.336704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.336826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.336886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.336962] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bf22cd1-36f8-47a6-b33f-a4955eef2052 is going to be updated. [ 960.357493] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.357493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.357493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.357652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.357772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.357897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bf22cd1-36f8-47a6-b33f-a4955eef2052" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.409520] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.409725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.409829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.410065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.410162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.410369] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.410471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.410534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.410685] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.410763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.410852] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 306ade67-3f30-492d-a51d-d4eb542da01d is going to be updated. [ 960.441779] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.441943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.442063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.442321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.442457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.452015] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 306ade67-3f30-492d-a51d-d4eb542da01d in Status: IN_PROGRESS for 2s [ 960.589164] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 960.589690] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 960.589814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.589960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.590229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.590411] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.590532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.590593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.590743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.590819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.590910] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.093651] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.219344] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.219615] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.219746] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.220020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.220290] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.220482] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.220610] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.220923] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.221090] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.221329] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.221459] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 961.221601] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 961.221686] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 961.221812] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 961.221886] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 961.222065] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 961.240924] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 961.241059] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 961.241219] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 961.241370] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.241664] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-e24adb4d-9559-47ac-8a5e-d2d27540ba75 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.241831] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.241952] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.242260] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.242405] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e24adb4d-9559-47ac-8a5e-d2d27540ba75',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.513055] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 961.513320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.513614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.513697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.513867] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.513985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.514063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.514216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.514297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.514381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.514468] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.598556] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.745336] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.745336] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.745466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.745773] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.745926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.746259] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.746423] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.746573] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.746805] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.746941] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.747246] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.747420] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.747790] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.747790] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.748264] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.748466] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 is going to be updated. [ 961.767721] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.768033] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.768200] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.769064] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.769316] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.769605] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.019618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.019618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.019618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.019618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.019618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.020359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.020359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.020359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.020359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.020359] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.102142] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.102142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.102325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.102383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.102443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.102543] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 962.132032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.132032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.132032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.132032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.132032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.140359] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 962.460606] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 306ade67-3f30-492d-a51d-d4eb542da01d in Status: SUCCESS [ 962.460823] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 306ade67-3f30-492d-a51d-d4eb542da01d deletion is rescheduled due to dependency. [ 962.461043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-306ade67-3f30-492d-a51d-d4eb542da01d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.523292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe: rpc.has_security_group_logging(os_id): False [ 962.541018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.541018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.541018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.541018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.541018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.541364] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.541364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.541364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.541497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.541497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.541636] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.541734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.541807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.541990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.542097] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.542303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.542397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.542457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.542601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.542671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.542757] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be updated. [ 962.596084] env[70287]: INFO networking_nsxv3.common.synchronization [req-ebb58db4-acbd-4278-be9a-33325ed83c10 req-84739b78-57df-45bb-846b-1ab0aafa940d service nova] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 962.596288] env[70287]: INFO networking_nsxv3.common.synchronization [req-ebb58db4-acbd-4278-be9a-33325ed83c10 req-84739b78-57df-45bb-846b-1ab0aafa940d service nova] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 962.596430] env[70287]: INFO networking_nsxv3.common.synchronization [req-ebb58db4-acbd-4278-be9a-33325ed83c10 req-84739b78-57df-45bb-846b-1ab0aafa940d service nova] Enqueued Resource ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 with Priority: HIGHEST for action port [ 962.596719] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_rules [ 962.596857] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 962.597040] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 with Priority: HIGHEST for action port [ 962.597485] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.597807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.597884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.598095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.598179] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.599065] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.599185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.599254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.599425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.599568] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.599658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.599712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.599859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.599924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.600015] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.600697] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e24adb4d-9559-47ac-8a5e-d2d27540ba75 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.601030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.601030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.601030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.601188] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e24adb4d-9559-47ac-8a5e-d2d27540ba75',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.609515] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.609515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.609515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.609515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.609515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.624557] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 963.104040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.104040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.104040] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.104693] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e24adb4d-9559-47ac-8a5e-d2d27540ba75 with status ACTIVE [ 963.104875] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.104988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.105069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.105285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.105398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.105564] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.105664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.105707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.105858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.105935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.106129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.106229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.106290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.106693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.106693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.106693] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e24adb4d-9559-47ac-8a5e-d2d27540ba75 is going to be updated. [ 963.125876] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.126049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.126093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.126287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.126418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.126576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e24adb4d-9559-47ac-8a5e-d2d27540ba75" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.609219] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.807720] env[70287]: INFO networking_nsxv3.common.synchronization [req-7d5dd38f-9a18-4bb3-a84c-54f65ba339c8 req-f30c26f8-6caf-4716-9560-a9780b846a93 tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_members [ 963.808446] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 with Priority: HIGHEST for action security_group_members [ 963.809727] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.809727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.809727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.810103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.810103] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.810103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.810916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.811495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.811593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.811762] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eed43c9b-e09e-4fd2-87aa-ee48b0ab6706',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.112304] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.112461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.112533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.112750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.113843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.113843] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 is going to be updated. [ 964.139931] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.139931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.139931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.139931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.139931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.149791] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: IN_PROGRESS for 2s [ 964.150129] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 964.150325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.150674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.150674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.150852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.151330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.151330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.151330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.151330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.151655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.151655] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.274786] env[70287]: INFO networking_nsxv3.common.synchronization [req-780f3481-aeb8-4a7c-9db3-7c9c82c8c7bf req-8a11d91b-78c1-4caa-8700-c795e806f3b9 tempest-ImagesTestJSON-1314117926 tempest-ImagesTestJSON-1314117926-project-member] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 964.275553] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGHEST for action security_group_members [ 964.276125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.276302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.276343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.276650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.276826] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.276930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.276989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.277156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.277234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.277325] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.317730] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.317923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.317972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.318180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.318273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.318470] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.318577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.318640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.318871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.318948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.319050] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 is going to be updated. [ 964.343073] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.343180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.343247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.343466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.343641] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.353423] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 in Status: IN_PROGRESS for 2s [ 964.637210] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 964.637482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.654156] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.655081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.655081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.655081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.655081] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.655081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.655081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.655401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.655401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.655699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.655745] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.655841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.655884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.656040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.657244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.657244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.657244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.657244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.657244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.657244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.657244] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.782042] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.782042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.782042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.782302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.782302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.782451] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.782553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.782615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.782762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.782836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.782922] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be updated. [ 964.812449] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.814034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.814034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.814034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.814034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.821612] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: IN_PROGRESS for 2s [ 965.160285] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e5e0f30-956b-4713-b190-79d66c86985e: rpc.has_security_group_logging(os_id): False [ 965.189533] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.189713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.189791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.189959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.190063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.190294] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.190395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.190465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.190761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.190761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.190938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.190938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.191149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.191149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.191250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.191357] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.191447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.191697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.191697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.191697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.191838] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 965.272667] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.272835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.272884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.273132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.273373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.289750] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 966.160518] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: SUCCESS [ 966.160809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.160988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.161349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.161642] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.161760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.161825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.161991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.162089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.162215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.162346] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.364382] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 in Status: SUCCESS [ 966.364558] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eed43c9b-e09e-4fd2-87aa-ee48b0ab6706 deletion is rescheduled due to dependency. [ 966.364669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eed43c9b-e09e-4fd2-87aa-ee48b0ab6706" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.501578] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4e0c1ac-82fd-4fe5-8a66-2e6414172597 req-b1639ae8-941d-4fed-8db8-0127fbd2adcb tempest-ServersNegativeTestJSON-782058407 tempest-ServersNegativeTestJSON-782058407-project-member] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 966.502089] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 966.502383] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.503016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.503016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.503016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.503016] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.503016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.503763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.504316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.504316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.504316] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.555489] env[70287]: INFO networking_nsxv3.common.synchronization [None req-0acbbe8d-81f2-4a2e-8abb-fb0ca914dae3 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 1904796e-6ae0-46c0-b232-00ac461d1048 with Priority: HIGHEST for action security_group_rules [ 966.556167] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1904796e-6ae0-46c0-b232-00ac461d1048 with Priority: HIGHEST for action security_group_rules [ 966.556479] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1904796e-6ae0-46c0-b232-00ac461d1048 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.556679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.556679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.557011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.557011] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1904796e-6ae0-46c0-b232-00ac461d1048',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.641135] env[70287]: INFO networking_nsxv3.common.synchronization [req-ade671d4-97b5-4268-aee0-5be278228001 req-a52c133d-83ed-4cc8-a890-a5ce3e740e81 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 966.641715] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 966.642250] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.642433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.642526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.642754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.642942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.643056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.643156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.643356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.643478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.643600] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.664998] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.701614] env[70287]: INFO networking_nsxv3.common.synchronization [None req-0d7bd5b9-9d24-4737-9249-10215ec52fd0 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 1904796e-6ae0-46c0-b232-00ac461d1048 with Priority: HIGHEST for action security_group_rules [ 966.702088] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1904796e-6ae0-46c0-b232-00ac461d1048 with Priority: HIGHEST for action security_group_rules [ 966.702414] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1904796e-6ae0-46c0-b232-00ac461d1048 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.702520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.831567] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 in Status: SUCCESS [ 966.831751] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 deletion is rescheduled due to dependency. [ 966.831751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.007426] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.076185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.076291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.076291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.076512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.076621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.076716] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1904796e-6ae0-46c0-b232-00ac461d1048 already deleted. [ 967.076806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.076959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.077128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.077202] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1904796e-6ae0-46c0-b232-00ac461d1048',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.147090] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.171180] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae697c95-678e-4288-aec7-3a6fe1dee306: rpc.has_security_group_logging(os_id): False [ 967.186613] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.186912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.186912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.187089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.187164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.187711] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.187711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.187711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.187911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.187967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.188036] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 is going to be updated. [ 967.241744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.241929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.242080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.242328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.242504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.254316] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: IN_PROGRESS for 2s [ 967.338034] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 967.338272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.510593] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.601122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.601278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.601368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.601575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.601666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.601775] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1904796e-6ae0-46c0-b232-00ac461d1048 already deleted. [ 967.601870] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1904796e-6ae0-46c0-b232-00ac461d1048" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.649690] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.014281] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.014281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.014281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.014281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.014281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.014281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be updated. [ 968.043777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.043966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.044082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.044397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.044575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.053397] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 968.152626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.152626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.152841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.153471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.153606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.153731] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 968.187913] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.188238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.188238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.188368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.188516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.196643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 969.268944] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: SUCCESS [ 969.269306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.782311] env[70287]: INFO networking_nsxv3.common.synchronization [req-abc64995-038f-41c3-bc7a-28f273d0c42b req-3bb9a662-5737-4cee-943e-41237fdec8dc tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 969.782311] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 969.782311] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.782311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.782830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.783216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.783646] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.783923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.784099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.784383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.784603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.784799] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.065221] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 970.065221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.221071] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 970.221071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.290637] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.290994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.290994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.291100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.291198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.291433] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.291539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.291601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.291858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.291944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.292054] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 970.319069] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.319275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.319275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.319501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.319635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.331939] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 971.491820] env[70287]: INFO networking_nsxv3.common.synchronization [req-8c4eed92-0159-4c3d-82b5-bbba746459c2 req-1d03b544-d633-4fea-9610-efd9e6385d7f tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 971.492152] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 971.492328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.492445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.492509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.492707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.492861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.492960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.493029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.493180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.493258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.493349] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.996769] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.015243] env[70287]: INFO networking_nsxv3.common.synchronization [req-a897f118-e89f-4440-adb9-6bd9c65fccb7 req-fa3d88d0-f3f8-4b40-8c67-acee8d3884c8 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 972.015243] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 972.015243] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.015243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.015243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.015243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.017114] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.018307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.018404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.018618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.018715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.018835] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.345647] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 972.345647] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 972.345647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.360036] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.360036] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.360036] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.360349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.360760] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.361113] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.361371] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.363210] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.363210] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.363210] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.363210] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 972.363210] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 972.363210] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 972.363210] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 972.363210] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 972.363210] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 972.381477] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 972.381641] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 972.381783] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 972.381966] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.382313] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.382490] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.382614] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.382926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.383092] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5f71a3-58d6-4ff0-a685-94cbe8d7279c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.498671] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.521607] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.886108] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.887040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.887040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.887040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.887040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.887273] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port dc5f71a3-58d6-4ff0-a685-94cbe8d7279c not found, creating... [ 972.887417] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.887598] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.887716] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.887982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.888139] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.888434] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.888621] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.888759] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.889053] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.889204] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.889351] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: dc5f71a3-58d6-4ff0-a685-94cbe8d7279c is going to be created. [ 972.911088] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.911088] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.911088] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.911088] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.911088] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.911088] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.001064] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.001312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.001418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.001661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.001790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.001914] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 973.024040] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.037744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.037854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.037951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.038209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.038394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.054638] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 973.527461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.527993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.527993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.528105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.528105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.528219] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be updated. [ 973.553748] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.553909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.553982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.554219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.554361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.565485] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 2s [ 973.629277] env[70287]: INFO networking_nsxv3.common.synchronization [req-a897f118-e89f-4440-adb9-6bd9c65fccb7 req-d63589e1-dc3d-41ce-9709-ee9433fef564 service nova] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 973.629471] env[70287]: INFO networking_nsxv3.common.synchronization [req-a897f118-e89f-4440-adb9-6bd9c65fccb7 req-d63589e1-dc3d-41ce-9709-ee9433fef564 service nova] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 973.629620] env[70287]: INFO networking_nsxv3.common.synchronization [req-a897f118-e89f-4440-adb9-6bd9c65fccb7 req-d63589e1-dc3d-41ce-9709-ee9433fef564 service nova] Enqueued Resource ID: dc5f71a3-58d6-4ff0-a685-94cbe8d7279c with Priority: HIGHEST for action port [ 973.629873] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_rules [ 973.630639] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 973.630639] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc5f71a3-58d6-4ff0-a685-94cbe8d7279c with Priority: HIGHEST for action port [ 973.630879] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.630939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.630977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.638149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.638256] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.639401] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.639511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.639728] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.639836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.639898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.640102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.640179] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc5f71a3-58d6-4ff0-a685-94cbe8d7279c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.143551] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.143551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.143551] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc5f71a3-58d6-4ff0-a685-94cbe8d7279c with status ACTIVE [ 974.143809] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.143809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.143904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.144078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.144846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.144846] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.144846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.144846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.144846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.144846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.145109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.145109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.145109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.145240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.145276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.145989] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc5f71a3-58d6-4ff0-a685-94cbe8d7279c is going to be updated. [ 974.170906] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.171065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.171135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.171356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.171490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.171657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc5f71a3-58d6-4ff0-a685-94cbe8d7279c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.069792] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 975.069792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.308561] env[70287]: INFO networking_nsxv3.common.synchronization [req-c844b47e-7044-4b11-990c-05523dbe589a req-87a15726-e5af-4d30-8de8-8b2ef375c43a tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 975.309100] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 975.309401] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.309524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.309632] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.309788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.309934] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.310156] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.310239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.310401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.310488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.310583] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.574661] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 975.575429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.575429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.575589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.576093] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.576286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.576441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.576621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.576928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.576928] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.812395] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.812395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.812551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.813174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.813174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.813174] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.813174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.813174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.813621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.813621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.813621] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 975.857087] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.857249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.857320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.857528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.857669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.875156] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 976.080318] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.584123] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.088802] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.089151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.089375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.089614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.089714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.089845] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be updated. [ 977.115550] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.115764] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.115841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.116018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.116163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.125779] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 2s [ 977.884709] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 977.884888] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 977.884994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.133766] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 979.134160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.134287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.134484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.134742] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.134884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.134943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.135147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.135227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.135311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.135398] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.637704] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.140485] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521389fe-7ad3-45db-944a-1438ff593c45: rpc.has_security_group_logging(os_id): False [ 980.163512] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.163512] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.163512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.163512] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be updated. [ 980.221857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.222311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.222311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.222474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.223212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.242267] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 2s [ 980.316313] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 980.316313] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 981.501525] env[70287]: INFO networking_nsxv3.common.synchronization [None req-a4eb4fd6-4e82-4cb5-92ae-0df96a0bcd04 None None] Enqueued Resource ID: db82092c-0b87-4bca-abc6-b124205f9a21 with Priority: HIGHEST for action port [ 981.501851] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db82092c-0b87-4bca-abc6-b124205f9a21 with Priority: HIGHEST for action port [ 981.502372] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-db82092c-0b87-4bca-abc6-b124205f9a21 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.502499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db82092c-0b87-4bca-abc6-b124205f9a21" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.502568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db82092c-0b87-4bca-abc6-b124205f9a21" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.502814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db82092c-0b87-4bca-abc6-b124205f9a21" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.502897] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db82092c-0b87-4bca-abc6-b124205f9a21',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.007193] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db82092c-0b87-4bca-abc6-b124205f9a21 [ 982.007466] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.007607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.007671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.007903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.008022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.008162] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db82092c-0b87-4bca-abc6-b124205f9a21 already deleted. [ 982.008252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db82092c-0b87-4bca-abc6-b124205f9a21" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.255288] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 982.255288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.636630] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f1bde47f-6ff6-4a12-b05f-7bc2f779d2e0 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 983.637206] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 983.637538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.637689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.637757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.637976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.643388] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.643388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.643388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.643388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.643388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.643388] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.147317] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.147317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.147317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.147640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.147695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.148116] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.148257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.148315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.148543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.148620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.148673] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 984.171771] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.171924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.171987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.172315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.172548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.181097] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 986.195247] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 986.195652] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d deletion is rescheduled due to dependency. [ 986.195652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.260420] env[70287]: INFO networking_nsxv3.common.synchronization [None req-84e4ab11-a797-4b82-86a8-595d338aa8ef None None] Enqueued Resource ID: 75e7d8c4-837d-4370-b06d-d029672b1030 with Priority: HIGHEST for action port [ 986.261035] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e7d8c4-837d-4370-b06d-d029672b1030 with Priority: HIGHEST for action port [ 986.261415] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-75e7d8c4-837d-4370-b06d-d029672b1030 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.261546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75e7d8c4-837d-4370-b06d-d029672b1030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.261610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75e7d8c4-837d-4370-b06d-d029672b1030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.261851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75e7d8c4-837d-4370-b06d-d029672b1030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.261930] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75e7d8c4-837d-4370-b06d-d029672b1030',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.316946] env[70287]: INFO networking_nsxv3.common.synchronization [req-1237834e-a1b0-4b45-a1e9-a91534320cc7 req-616f832e-e163-4ee5-a971-2f40dbbfdb51 tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 986.318348] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 986.319055] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.319230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.319302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.320579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.320579] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.320579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.320579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.320579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.320579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.320579] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.762465] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-890 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.762986] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-890" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.763291] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-890" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.763730] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-890" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.764634] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.764634] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.764634] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.764851] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.764946] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.765182] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.765672] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 986.765858] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 986.765983] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 986.766124] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 986.766241] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 986.766385] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 986.767736] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 75e7d8c4-837d-4370-b06d-d029672b1030 [ 986.767906] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.768018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.768081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.768244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.768486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.768486] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:75e7d8c4-837d-4370-b06d-d029672b1030 already deleted. [ 986.768486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75e7d8c4-837d-4370-b06d-d029672b1030" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.786843] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 986.787778] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 986.787778] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 986.787778] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-890" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.787778] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-c3732b54-5e41-439b-b520-dd176b893e67 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.787998] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.787998] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.788314] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.788455] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3732b54-5e41-439b-b520-dd176b893e67',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.823335] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.823508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.823588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.823851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.823949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.824160] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.824262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.824327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.824472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.824547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.824634] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 already deleted. [ 986.824714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.291297] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.291612] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.291741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.292538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.292778] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.293576] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port c3732b54-5e41-439b-b520-dd176b893e67 not found, creating... [ 987.293953] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.294223] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.294431] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.294682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.294873] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.295314] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.295474] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.295631] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.295920] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.296116] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.296277] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: c3732b54-5e41-439b-b520-dd176b893e67 is going to be created. [ 987.315820] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.316063] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.316198] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.316454] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.316686] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.316935] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.033502] env[70287]: INFO networking_nsxv3.common.synchronization [req-1237834e-a1b0-4b45-a1e9-a91534320cc7 req-375c31d2-dcb8-4063-92f0-a4b6a0ae913b service nova] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_rules [ 988.033502] env[70287]: INFO networking_nsxv3.common.synchronization [req-1237834e-a1b0-4b45-a1e9-a91534320cc7 req-375c31d2-dcb8-4063-92f0-a4b6a0ae913b service nova] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 988.033618] env[70287]: INFO networking_nsxv3.common.synchronization [req-1237834e-a1b0-4b45-a1e9-a91534320cc7 req-375c31d2-dcb8-4063-92f0-a4b6a0ae913b service nova] Enqueued Resource ID: c3732b54-5e41-439b-b520-dd176b893e67 with Priority: HIGHEST for action port [ 988.034265] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_rules [ 988.034399] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 988.034473] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3732b54-5e41-439b-b520-dd176b893e67 with Priority: HIGHEST for action port [ 988.034834] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.034985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.035536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.036316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.037716] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.039554] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.041578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.042395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.042459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.043100] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.043489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.043595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.043835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.044103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.044157] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.045835] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3732b54-5e41-439b-b520-dd176b893e67 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.045942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.046049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.046325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.046630] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3732b54-5e41-439b-b520-dd176b893e67',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.250596] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ad5ac1cb-1207-4364-b72d-872edab64e32 None None] Enqueued Resource ID: ba391f5a-cf79-4191-921e-bcad9eafef8a with Priority: HIGHEST for action port [ 988.251060] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba391f5a-cf79-4191-921e-bcad9eafef8a with Priority: HIGHEST for action port [ 988.251366] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba391f5a-cf79-4191-921e-bcad9eafef8a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.251485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba391f5a-cf79-4191-921e-bcad9eafef8a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.251547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba391f5a-cf79-4191-921e-bcad9eafef8a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.251795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba391f5a-cf79-4191-921e-bcad9eafef8a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.251869] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba391f5a-cf79-4191-921e-bcad9eafef8a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.540725] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.541077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.546313] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.553306] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3732b54-5e41-439b-b520-dd176b893e67 with status ACTIVE [ 988.553565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.553728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.553807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.554011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.554284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.554284] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.554487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.554487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.554616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.554660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.554820] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.555909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.555909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.555909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.555909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.555909] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3732b54-5e41-439b-b520-dd176b893e67 is going to be updated. [ 988.574598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.574786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.574853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.575019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.575166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.575326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.622835] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.623080] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.623248] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.623492] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.623764] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.626443] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.626597] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.626845] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.627007] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.627230] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.627349] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.627462] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.627575] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.627687] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 988.627802] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.627946] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.646592] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.646764] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 988.646880] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.647482] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.647482] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f0a189f1-458e-4340-bdc8-db4d5993fad1 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.647864] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.647864] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.648019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.648161] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a189f1-458e-4340-bdc8-db4d5993fad1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.755021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ba391f5a-cf79-4191-921e-bcad9eafef8a [ 988.755021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.755021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.755021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.755021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.755021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.755021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ba391f5a-cf79-4191-921e-bcad9eafef8a already deleted. [ 988.755021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba391f5a-cf79-4191-921e-bcad9eafef8a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.052402] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.151554] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.151767] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.151907] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.152201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.152355] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.152657] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f0a189f1-458e-4340-bdc8-db4d5993fad1 not found, creating... [ 989.152950] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.153187] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.153719] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.153719] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.157142] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.158135] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.158135] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.158135] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.158135] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.158135] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.158445] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 is going to be created. [ 989.175583] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.175818] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.176012] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.176260] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.176493] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.176718] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.344499] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f5d279a-df90-45a6-a120-f09c2115afda req-3b4f087c-6d8f-4e73-b4b8-817311a6de03 tempest-ListServerFiltersTestJSON-741390594 tempest-ListServerFiltersTestJSON-741390594-project-member] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 989.345723] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 989.346181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.346449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.346624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.346958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.347217] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.347433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.349098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.349098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.349098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.349098] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.554496] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.554795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.554795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.555392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.555392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.555392] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be created. [ 989.577439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.577603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.577673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.578162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.578162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.586874] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: UNINITIALIZED for 2s [ 989.718463] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.718463] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.718785] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.719333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.719690] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.720037] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.720237] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.720525] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.720703] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.720945] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.721275] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.721409] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.721568] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.722377] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 989.722377] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.722377] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.739548] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.739725] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 989.739864] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.740090] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.740399] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-e67f3145-81ba-409d-afa0-46006c073fcc taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.740571] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.740695] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.744255] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.744414] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e67f3145-81ba-409d-afa0-46006c073fcc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.850886] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.851078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.851154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.851366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.851456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.851661] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.851758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.851822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.851973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.852060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.852640] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 already deleted. [ 989.852640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.929167] env[70287]: INFO networking_nsxv3.common.synchronization [req-729cb80b-3f78-4322-939d-c5ab0106a0c2 req-66faba9d-db7f-46cc-9322-d8169c08ebb3 service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 989.929359] env[70287]: INFO networking_nsxv3.common.synchronization [req-729cb80b-3f78-4322-939d-c5ab0106a0c2 req-66faba9d-db7f-46cc-9322-d8169c08ebb3 service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 989.929510] env[70287]: INFO networking_nsxv3.common.synchronization [req-729cb80b-3f78-4322-939d-c5ab0106a0c2 req-66faba9d-db7f-46cc-9322-d8169c08ebb3 service nova] Enqueued Resource ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 with Priority: HIGHEST for action port [ 989.930140] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 989.930216] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 989.930292] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 with Priority: HIGHEST for action port [ 989.930545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.930736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.930736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.930918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.931045] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.932224] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.932343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.932402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.932583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.932741] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.932846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.932921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.933090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.933197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.933307] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.934154] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0a189f1-458e-4340-bdc8-db4d5993fad1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.934270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.934730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.934730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.934730] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a189f1-458e-4340-bdc8-db4d5993fad1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.247319] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.247806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.247981] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.248299] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.248457] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.248688] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port e67f3145-81ba-409d-afa0-46006c073fcc not found, creating... [ 990.248909] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.249084] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.249286] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.249417] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.249807] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.250022] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.250174] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.250174] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.251021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.251021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.251021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: e67f3145-81ba-409d-afa0-46006c073fcc is going to be created. [ 990.269858] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.271080] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.271080] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.272023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.272023] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.272115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.436159] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.436296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.436485] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.437410] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0a189f1-458e-4340-bdc8-db4d5993fad1 with status ACTIVE [ 990.437590] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.438212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.438212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.438212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.438212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.438360] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.438360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.438431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.438570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.438647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.438828] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.438923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.438984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.439137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.439222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.439292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 is going to be updated. [ 990.461370] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.461499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.461499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.461691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.461927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.461983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.941634] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.282869] env[70287]: INFO networking_nsxv3.common.synchronization [req-cb82c0ea-c36a-4824-8e52-5867edee3255 req-35cc5efe-305b-4678-ba05-84d7e8615ca0 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_members [ 991.283524] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGHEST for action security_group_members [ 991.285108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.285278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.285344] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.285603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.285798] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.285923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.286114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.286198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.286255] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.286350] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.368027] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f5d279a-df90-45a6-a120-f09c2115afda req-fa47c200-ac3f-48c1-b97f-ebd2666b1743 service nova] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_rules [ 991.368027] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f5d279a-df90-45a6-a120-f09c2115afda req-fa47c200-ac3f-48c1-b97f-ebd2666b1743 service nova] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 991.368027] env[70287]: INFO networking_nsxv3.common.synchronization [req-5f5d279a-df90-45a6-a120-f09c2115afda req-fa47c200-ac3f-48c1-b97f-ebd2666b1743 service nova] Enqueued Resource ID: e67f3145-81ba-409d-afa0-46006c073fcc with Priority: HIGHEST for action port [ 991.368027] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_rules [ 991.368027] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 991.368027] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e67f3145-81ba-409d-afa0-46006c073fcc with Priority: HIGHEST for action port [ 991.368027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.368929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.369269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.369618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.370330] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.372392] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.372649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.372796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.373057] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.373300] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.373543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.373695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.373945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.374586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.374790] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.376148] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e67f3145-81ba-409d-afa0-46006c073fcc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.376379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.376576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.376805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.376963] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e67f3145-81ba-409d-afa0-46006c073fcc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.444297] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.444488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.444542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.444731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.444822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.444924] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 991.476185] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.476185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.476185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.476185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.476185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.487536] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 991.596977] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 991.596977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.596977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.596977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.597116] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.597777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.597777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.597777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.597777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.597777] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.621916] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4e330cf-5586-45f7-91a7-9ee80bf48a4c req-e778a62f-61ec-4196-bbd6-b90e754e7d9b tempest-ListServerFiltersTestJSON-741390594 tempest-ListServerFiltersTestJSON-741390594-project-member] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 991.622501] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 991.622805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.622911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.788397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.788695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.788695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.788873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.788937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.789186] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.789287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.789348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.789509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.789597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.789674] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c is going to be updated. [ 991.844779] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.844779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.844779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.845086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.845238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.853856] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: IN_PROGRESS for 2s [ 991.873064] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.873249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.876972] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.881217] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e67f3145-81ba-409d-afa0-46006c073fcc with status ACTIVE [ 991.882025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.882025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.882025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.882025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.882025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.882318] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.882318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.882318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.882423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.882469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.882675] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.882742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.882802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.882925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.882992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.884671] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e67f3145-81ba-409d-afa0-46006c073fcc is going to be updated. [ 991.906847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.906847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.906847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.906847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.906847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.906847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e67f3145-81ba-409d-afa0-46006c073fcc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.065486] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.067140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.067140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.067140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.067140] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.067140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.067140] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.067669] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.068515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.068515] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.068515] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.068515] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.068652] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.068693] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 992.068989] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.068989] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.087632] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.087791] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 992.088072] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.088233] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.088607] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.088828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.088909] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.089251] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.089873] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d3b4f23-c77f-4eb3-870b-ebb46097cfda',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.102521] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.102757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.102804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.103121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.103303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.103409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.103473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.103683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.103775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.103862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.104060] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.104164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.104225] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.104380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.104516] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.104607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.104668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.105067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.105067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.105067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.105067] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.381384] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.591757] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.592053] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.592204] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.593361] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.593361] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.593361] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 9d3b4f23-c77f-4eb3-870b-ebb46097cfda not found, creating... [ 992.593361] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.593361] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.593361] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.593589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.593726] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.593976] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.594149] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.594408] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.594504] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.594600] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.594741] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 9d3b4f23-c77f-4eb3-870b-ebb46097cfda is going to be created. [ 992.611178] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095: rpc.has_security_group_logging(os_id): False [ 992.613721] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.613983] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.614661] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.614972] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.615226] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.615491] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.628636] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.628797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.628855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.629087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.629254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.629392] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.629498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.629571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.629730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.629805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.630039] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.630147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.630221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.630357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.630429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.630610] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.630703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.630762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.630913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.630983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.631087] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be created. [ 992.713120] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.713312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.713383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.713550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.713738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.724994] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: IN_PROGRESS for 2s [ 992.883732] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.883893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.883967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.884217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.884309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.884414] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be created. [ 992.907610] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.907761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.907794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.908014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.908208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.918938] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: UNINITIALIZED for 2s [ 993.368783] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4e330cf-5586-45f7-91a7-9ee80bf48a4c req-8ecddc38-68bc-4f96-9e0d-a33793f14b16 service nova] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_rules [ 993.369035] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4e330cf-5586-45f7-91a7-9ee80bf48a4c req-8ecddc38-68bc-4f96-9e0d-a33793f14b16 service nova] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 993.369070] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4e330cf-5586-45f7-91a7-9ee80bf48a4c req-8ecddc38-68bc-4f96-9e0d-a33793f14b16 service nova] Enqueued Resource ID: 9d3b4f23-c77f-4eb3-870b-ebb46097cfda with Priority: HIGHEST for action port [ 993.369686] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_rules [ 993.370196] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 993.370196] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d3b4f23-c77f-4eb3-870b-ebb46097cfda with Priority: HIGHEST for action port [ 993.370281] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.370335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.370534] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.370620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.370822] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.370924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.370993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.371306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.371340] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d3b4f23-c77f-4eb3-870b-ebb46097cfda',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.494466] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 993.494656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.494799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.495043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.495241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.495360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.495426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.495569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.495654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.495737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.495872] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.597356] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent loop - iteration:1 completed [ 993.597484] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent loop - iteration:2 started [ 993.863769] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 103dc013-133c-4ce6-897f-dbfb9383e30c in Status: SUCCESS [ 993.863999] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c deletion is rescheduled due to dependency. [ 993.864174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.873625] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9d3b4f23-c77f-4eb3-870b-ebb46097cfda with status ACTIVE [ 993.873901] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.874080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.874178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.874444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.874563] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.874799] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.874939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.875045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.875253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.875364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.875616] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.875751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.875879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.876079] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.876190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.876310] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9d3b4f23-c77f-4eb3-870b-ebb46097cfda is going to be updated. [ 993.899454] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.899594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.899664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.899859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.899991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.900160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d3b4f23-c77f-4eb3-870b-ebb46097cfda" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.922719] env[70287]: INFO networking_nsxv3.common.synchronization [req-52a39761-5050-4aac-b046-ea1e1379e504 req-8d1ce2d6-9ed2-41c6-815f-4409c87bb29a tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 993.923290] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 993.923584] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.923719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.923785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.924090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.924255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.924353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.924411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.924586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.924671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.924761] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.998188] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.998354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.998408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.998620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.998791] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.998891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.998950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.999116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.999202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.999287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.999433] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.999524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.999583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.999719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.999856] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.999934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.999988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.000139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.000207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.000287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.000372] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.427645] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.427645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.427645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.427978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.427978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.428094] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.428094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.428188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.429033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.429033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.429033] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 already deleted. [ 994.429033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.502744] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d: rpc.has_security_group_logging(os_id): False [ 994.519426] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.519426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.519570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.519850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.519955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.520177] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.520283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.520345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.520493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.520570] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.520747] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.520841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.520901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.521050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.521123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.521363] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.521463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.521523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.521661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.521735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.521819] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 994.568624] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.568819] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.569018] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.569329] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.569595] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.570176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.570176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.570176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.570295] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.570524] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.570652] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.570765] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.570874] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.570987] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 994.571112] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.571248] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.576658] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.576762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.576883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.576979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.577152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.589200] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.589354] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 994.589493] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.589665] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.589985] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-7baeaa4b-dc16-48c9-b17b-ea555512783c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.590179] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.590303] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.590594] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.590734] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7baeaa4b-dc16-48c9-b17b-ea555512783c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.592466] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 994.736120] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 994.736369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.928707] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 994.928928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.929119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.929342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.929528] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.929645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.929712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.929866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.929942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.930046] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.092662] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.092901] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.093046] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.093335] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.093495] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.093663] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 7baeaa4b-dc16-48c9-b17b-ea555512783c not found, creating... [ 995.093945] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.094132] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.094256] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.094487] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.094635] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.094917] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.095091] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.095224] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.095442] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.095583] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.095727] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 7baeaa4b-dc16-48c9-b17b-ea555512783c is going to be created. [ 995.113136] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.113343] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.113472] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.113774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.114199] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.114449] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.432609] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.935247] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.256520] env[70287]: INFO networking_nsxv3.common.synchronization [req-52a39761-5050-4aac-b046-ea1e1379e504 req-5c5a98bb-a306-4393-ac2d-d4e3fdbd48d9 service nova] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_rules [ 996.256711] env[70287]: INFO networking_nsxv3.common.synchronization [req-52a39761-5050-4aac-b046-ea1e1379e504 req-5c5a98bb-a306-4393-ac2d-d4e3fdbd48d9 service nova] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 996.256981] env[70287]: INFO networking_nsxv3.common.synchronization [req-52a39761-5050-4aac-b046-ea1e1379e504 req-5c5a98bb-a306-4393-ac2d-d4e3fdbd48d9 service nova] Enqueued Resource ID: 7baeaa4b-dc16-48c9-b17b-ea555512783c with Priority: HIGHEST for action port [ 996.257585] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_rules [ 996.257724] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 996.257823] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7baeaa4b-dc16-48c9-b17b-ea555512783c with Priority: HIGHEST for action port [ 996.258352] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.258505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.258557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.258813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.258896] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.260944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.261121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.261193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.261380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.261533] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.261632] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.261694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.261833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.261916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.262015] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.266198] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7baeaa4b-dc16-48c9-b17b-ea555512783c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.266198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.266198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.266198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.266198] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7baeaa4b-dc16-48c9-b17b-ea555512783c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.438846] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.439130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.439130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.439329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.439415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.439519] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 996.490310] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.490462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.490532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.490733] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.490879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.502047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 996.503964] env[70287]: INFO networking_nsxv3.common.synchronization [req-b0310328-2581-4c25-97f7-8ecb3fe31b73 req-3fc36923-da21-41ae-b8c9-2e93fbe6d112 tempest-ListServerFiltersTestJSON-741390594 tempest-ListServerFiltersTestJSON-741390594-project-member] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 996.504506] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 996.504848] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.504921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.618319] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 996.618560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.762027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.762147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.766089] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.768880] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7baeaa4b-dc16-48c9-b17b-ea555512783c with status ACTIVE [ 996.769107] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.769228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.769293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.769518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.769603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.769779] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.769872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.769931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.770308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.770308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.770388] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.770673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.770673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.770673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.770770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.770770] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7baeaa4b-dc16-48c9-b17b-ea555512783c is going to be updated. [ 996.792495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.792721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.792860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.793427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.793427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.793668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7baeaa4b-dc16-48c9-b17b-ea555512783c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.837589] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-691 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.837829] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.837829] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.838059] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.838491] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.838491] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.838611] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.838820] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.839083] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.839571] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.839571] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.839571] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.839894] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.839894] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 996.839894] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.840153] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.859784] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.860184] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 996.860184] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.860327] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-691" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.860742] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-4c12b9ac-3b19-401c-8185-d9518a07e8d8 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.861032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.861109] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.861482] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.861628] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c12b9ac-3b19-401c-8185-d9518a07e8d8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.269686] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.364801] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.365191] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.365404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.366371] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.366594] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.366915] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 4c12b9ac-3b19-401c-8185-d9518a07e8d8 not found, creating... [ 997.367211] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.367491] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.367727] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.367906] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.368337] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.368684] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.368964] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.369227] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.369572] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.369804] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.370112] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 4c12b9ac-3b19-401c-8185-d9518a07e8d8 is going to be created. [ 997.390652] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.390944] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.391180] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.391559] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.391816] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.392093] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.771730] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.772030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.772070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.772294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.772389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.772520] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be created. [ 997.795011] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.795211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.795301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.795518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.795674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.805246] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: UNINITIALIZED for 2s [ 998.182847] env[70287]: INFO networking_nsxv3.common.synchronization [req-b0310328-2581-4c25-97f7-8ecb3fe31b73 req-b920f743-cf85-48e9-ac11-24a5dc6bd83e service nova] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_rules [ 998.182847] env[70287]: INFO networking_nsxv3.common.synchronization [req-b0310328-2581-4c25-97f7-8ecb3fe31b73 req-b920f743-cf85-48e9-ac11-24a5dc6bd83e service nova] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 998.182847] env[70287]: INFO networking_nsxv3.common.synchronization [req-b0310328-2581-4c25-97f7-8ecb3fe31b73 req-b920f743-cf85-48e9-ac11-24a5dc6bd83e service nova] Enqueued Resource ID: 4c12b9ac-3b19-401c-8185-d9518a07e8d8 with Priority: HIGHEST for action port [ 998.183173] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_rules [ 998.183292] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 998.183441] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c12b9ac-3b19-401c-8185-d9518a07e8d8 with Priority: HIGHEST for action port [ 998.183979] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.186122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.186349] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.186458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.186874] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c12b9ac-3b19-401c-8185-d9518a07e8d8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.187035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.187108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.187315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.187394] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c12b9ac-3b19-401c-8185-d9518a07e8d8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.512826] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 998.513161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.513423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.513656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.513913] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.514063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.514146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.514302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.514423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.514564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.514690] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.515697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.515938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.516206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.516370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.516425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.516630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.516803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.516892] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.690217] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c12b9ac-3b19-401c-8185-d9518a07e8d8 with status ACTIVE [ 998.690302] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.691300] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.691300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.691854] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.691854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.691854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.691854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.691854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.692185] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c12b9ac-3b19-401c-8185-d9518a07e8d8 is going to be updated. [ 998.710736] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.710887] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.711437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.711437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.711549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.711687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c12b9ac-3b19-401c-8185-d9518a07e8d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.018790] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.019119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.019153] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.520944] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.815229] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: SUCCESS [ 999.815978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.815978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.815978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.816144] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.816241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.816300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.816500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.816533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.816620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.816702] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.024316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.024316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.024316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.024564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.025519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.025519] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1000.049295] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.049407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.050031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.050031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.050031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.058957] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1000.319950] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.320179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.320262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.320545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.320755] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.320881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.320962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.321186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.321321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.321401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.321629] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.322051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.322051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.322191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.322412] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.322561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.322666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.322869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.322999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.323280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.323416] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.827503] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 046d93ea-504a-4a85-9ee9-25113ed9b167: rpc.has_security_group_logging(os_id): False [ 1000.850028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.850028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.850028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.850028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.850659] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.850659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.850659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.856033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.856033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.856033] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be created. [ 1000.925188] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.925378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.925471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.926763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.926763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.938038] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: IN_PROGRESS for 2s [ 1001.853934] env[70287]: INFO networking_nsxv3.common.synchronization [req-5919e584-5112-40d7-a39b-87fe234be3be req-c8db5df5-b15c-4981-a3ae-e8477f3ab544 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1001.854555] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1001.855146] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.855341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.856077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.856077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.856077] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.856077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.856277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.856572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.856572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.856572] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.072479] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1002.073465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.073465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.076584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.076584] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.076584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.076584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.076584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.076584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.076584] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.366626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.366626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.366626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.366626] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1002.392142] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.392142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.392142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.392142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.392142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.398267] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1002.513918] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.513918] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.513918] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.513918] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.513918] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.514242] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.515171] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.515511] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.515684] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.516031] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.516108] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.516261] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.516353] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.516477] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1002.516592] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.516732] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.535616] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.535854] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1002.535991] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.536222] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.536688] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.536806] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.536904] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.537247] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.537398] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.578738] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.950424] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: SUCCESS [ 1002.950424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.042238] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.042679] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.042916] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.044494] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.044577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.044693] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 not found, creating... [ 1003.045141] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.045247] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.045294] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.045533] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.045686] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.046065] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.046277] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.046429] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.049834] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.049834] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.049834] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 is going to be created. [ 1003.067855] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.068089] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.068373] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.068638] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.068884] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.069133] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.082302] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.585468] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.585468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.585468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.585468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.585468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.585468] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1003.609849] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.609997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.610068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.611377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.611377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.619658] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1003.633643] env[70287]: INFO networking_nsxv3.common.synchronization [req-cbbe7f7c-0db0-400a-89ed-022b790cd635 req-adba7206-4476-47cd-b8af-49b5c6359efa tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 1003.633822] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 1003.634387] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.634524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.634583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.634765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.634911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.635008] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.635118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.635266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.635347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.635449] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.139585] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.261932] env[70287]: INFO networking_nsxv3.common.synchronization [req-5919e584-5112-40d7-a39b-87fe234be3be req-89667400-7a07-40e7-8009-0add3ad9f989 service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 1004.264894] env[70287]: INFO networking_nsxv3.common.synchronization [req-5919e584-5112-40d7-a39b-87fe234be3be req-89667400-7a07-40e7-8009-0add3ad9f989 service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1004.264894] env[70287]: INFO networking_nsxv3.common.synchronization [req-5919e584-5112-40d7-a39b-87fe234be3be req-89667400-7a07-40e7-8009-0add3ad9f989 service nova] Enqueued Resource ID: e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 with Priority: HIGHEST for action port [ 1004.264894] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 1004.264894] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1004.264894] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 with Priority: HIGHEST for action port [ 1004.264894] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.264894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.264894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.264894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.264894] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.268595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.268595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.268595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.268595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.268595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.268595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.268595] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.371528] env[70287]: INFO networking_nsxv3.common.synchronization [req-78225f90-ca92-4c9b-8951-8a4619b72699 req-b116e313-3f34-460f-8724-d478293e7aed tempest-ServersAdminTestJSON-90397065 tempest-ServersAdminTestJSON-90397065-project-member] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 1004.371528] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGHEST for action security_group_members [ 1004.371528] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.371528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.371528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.375187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.375616] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.375616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.375616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.375739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.376027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.376027] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.409042] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1004.409250] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 1004.409386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.409816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.410088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.412150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.412150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.412150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.412150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.412150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.412150] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.642525] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.769366] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.769366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.769366] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 with status ACTIVE [ 1004.769366] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.769366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.769366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.769366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.769702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.769702] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.769702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.769790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.769916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.770052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.770172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.770762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.770762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.770762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.770762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.770762] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889 is going to be updated. [ 1004.792063] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.792207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.792281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.792501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.792635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.792792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7e72cbb-60ea-4e7c-a8f2-8ca5cb130889" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.882068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.882068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.882068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.882068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.882068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.882068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.882323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.882323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.882323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.882407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.882511] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be updated. [ 1004.914490] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.929787] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.930102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.933972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.933972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.933972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.941413] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: IN_PROGRESS for 2s [ 1005.146251] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.146557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.146638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.146983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.147281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.147425] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 is going to be updated. [ 1005.173282] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.173601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.173883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.173980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.174179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.183339] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: IN_PROGRESS for 2s [ 1005.418033] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.627533] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1005.627842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.628087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.628373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.628626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.628782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.628872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.629088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.630172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.630172] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.851751] env[70287]: INFO networking_nsxv3.common.synchronization [None req-bd335804-29ab-4f99-afa0-0ea58337db28 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_rules [ 1005.852403] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_rules [ 1005.852957] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f041a33f-3065-4123-b535-0695dd2dbb6f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.852957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.852957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.853207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.853321] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.921461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.922151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.922151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.922151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.922151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.922314] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1005.951590] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.951759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.951806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.952037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.952172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.960140] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1006.059938] env[70287]: INFO networking_nsxv3.common.synchronization [None req-83a13733-04f1-40e6-9ece-bc8eff8f8e14 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_rules [ 1006.060493] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_rules [ 1006.061044] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f041a33f-3065-4123-b535-0695dd2dbb6f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.061192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.136733] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.374558] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.374558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.374558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.374558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.374558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.374558] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f041a33f-3065-4123-b535-0695dd2dbb6f already deleted. [ 1006.374558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.374558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.374558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.374558] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.641916] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.770761] env[70287]: INFO networking_nsxv3.common.synchronization [req-16745a6c-12c6-4abf-ad37-1295e5fa7988 req-46ffbbef-acd5-454c-8be4-7af3404c915b tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1006.770761] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1006.770869] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.770988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.772557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.772781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.773017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.773243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.773243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.773462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.773513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.773601] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.893736] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.893903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.893993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.894219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.894310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.894408] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f041a33f-3065-4123-b535-0695dd2dbb6f already deleted. [ 1006.894488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.951445] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aafb90fc-938c-44be-9296-60863884f367 in Status: SUCCESS [ 1006.951445] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aafb90fc-938c-44be-9296-60863884f367 deletion is rescheduled due to dependency. [ 1006.951445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.143015] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.143015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.143015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.143015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.143015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.143015] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1007.168845] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.169887] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.171726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.171726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.171726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.178286] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1007.191104] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: SUCCESS [ 1007.191481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.275882] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.371159] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.371441] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.371611] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.371947] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.372454] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.372685] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.372890] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.373223] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.373555] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.373729] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.373965] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.374155] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.374335] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.374494] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1007.374678] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.374906] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.392504] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.393041] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1007.393772] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.393772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.393772] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.393977] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.394176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.394585] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.394626] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf4ae18-00d3-464c-9535-5ed6443bdd1d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.778944] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.901675] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.902095] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.902311] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.902779] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.903067] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.903367] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port bbf4ae18-00d3-464c-9535-5ed6443bdd1d not found, creating... [ 1007.903826] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.904349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.904584] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.904992] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.905496] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.906021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.906479] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.906726] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.907138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.907699] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.907973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: bbf4ae18-00d3-464c-9535-5ed6443bdd1d is going to be created. [ 1007.931235] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.931539] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.931726] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.932113] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.932437] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.932756] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.978209] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.978209] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.978209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.978209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.092940] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-903 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.092940] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.092940] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.093228] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.093483] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.093655] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.096138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.096138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.096138] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.096138] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.096138] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.096138] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.096138] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.096138] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1008.096138] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.096138] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.126973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.127247] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1008.127410] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.127606] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-903" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.127968] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f0a189f1-458e-4340-bdc8-db4d5993fad1 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.128168] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.128326] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.128580] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.128716] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a189f1-458e-4340-bdc8-db4d5993fad1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.281153] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.282019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.282019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.282019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.282019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.282199] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1008.310044] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.310044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.310044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.310394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.310394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.319541] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1008.481703] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.482066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.482066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.482314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.482541] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.482702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.482807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.483017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.484108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.484108] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.484108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.484481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.484481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.484926] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.631670] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.631947] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.632107] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.632395] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.632588] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.632844] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.633014] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.633139] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.633377] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.633602] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.633868] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.633983] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.634119] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.634338] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.634472] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.634617] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 is going to be updated. [ 1008.654767] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.654984] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.655128] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.655390] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.655585] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.655828] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.662807] env[70287]: INFO networking_nsxv3.common.synchronization [req-16745a6c-12c6-4abf-ad37-1295e5fa7988 req-61107133-3912-43d3-8ab7-2f6e9415f4b5 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 1008.663124] env[70287]: INFO networking_nsxv3.common.synchronization [req-16745a6c-12c6-4abf-ad37-1295e5fa7988 req-61107133-3912-43d3-8ab7-2f6e9415f4b5 service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1008.663415] env[70287]: INFO networking_nsxv3.common.synchronization [req-16745a6c-12c6-4abf-ad37-1295e5fa7988 req-61107133-3912-43d3-8ab7-2f6e9415f4b5 service nova] Enqueued Resource ID: bbf4ae18-00d3-464c-9535-5ed6443bdd1d with Priority: HIGHEST for action port [ 1008.664081] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 1008.664272] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1008.664417] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbf4ae18-00d3-464c-9535-5ed6443bdd1d with Priority: HIGHEST for action port [ 1008.664777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.664944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.665056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.665319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.665432] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.666471] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.666608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.666861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.667489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.667593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.667813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.667917] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbf4ae18-00d3-464c-9535-5ed6443bdd1d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.987074] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1f591-bba8-479c-a2de-cf9524dceb77: rpc.has_security_group_logging(os_id): False [ 1009.014517] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.014699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.014773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.015219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.015219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.015324] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.015376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.015443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.015585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.015663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.015836] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.015929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.016024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.016158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.016237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.016491] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.016596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.016658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.016800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.016874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.016960] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1009.081806] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.081943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.082024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.082231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.082619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.094770] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1009.172769] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.172769] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbf4ae18-00d3-464c-9535-5ed6443bdd1d with status ACTIVE [ 1009.172769] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.172769] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.172769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.172769] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.173389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.173389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.173389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.173389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.173389] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbf4ae18-00d3-464c-9535-5ed6443bdd1d is going to be updated. [ 1009.196244] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.196244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.196244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.196244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.196244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.197798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.198064] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.198237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.198415] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.207183] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.210422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.210422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.210422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.210422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.210422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbf4ae18-00d3-464c-9535-5ed6443bdd1d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.319307] env[70287]: INFO networking_nsxv3.common.synchronization [None req-78111c96-51dd-42bf-b2bc-08a9b2136a6a None None] Enqueued Resource ID: 6171fb3b-4b28-4b0b-a1a6-59e802c3aad5 with Priority: HIGHEST for action port [ 1009.323021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6171fb3b-4b28-4b0b-a1a6-59e802c3aad5 with Priority: HIGHEST for action port [ 1009.323021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-6171fb3b-4b28-4b0b-a1a6-59e802c3aad5 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.323021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6171fb3b-4b28-4b0b-a1a6-59e802c3aad5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.323386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6171fb3b-4b28-4b0b-a1a6-59e802c3aad5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.323386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6171fb3b-4b28-4b0b-a1a6-59e802c3aad5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.323543] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6171fb3b-4b28-4b0b-a1a6-59e802c3aad5',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.577465] env[70287]: INFO networking_nsxv3.common.synchronization [req-2f46d031-8475-4344-b36f-56cf5185826e req-0d08bc0c-b707-43a0-bc8e-de6a2ae11cfc service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 1009.577791] env[70287]: INFO networking_nsxv3.common.synchronization [req-2f46d031-8475-4344-b36f-56cf5185826e req-0d08bc0c-b707-43a0-bc8e-de6a2ae11cfc service nova] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 1009.581129] env[70287]: INFO networking_nsxv3.common.synchronization [req-2f46d031-8475-4344-b36f-56cf5185826e req-0d08bc0c-b707-43a0-bc8e-de6a2ae11cfc service nova] Enqueued Resource ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 with Priority: HIGHEST for action port [ 1009.581767] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_rules [ 1009.581907] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 1009.582033] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 with Priority: HIGHEST for action port [ 1009.582320] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.582444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.582526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.582701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.582782] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.583896] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.584031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.584083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.584259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.584440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.584537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.584603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.584752] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.584839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.584928] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.586896] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0a189f1-458e-4340-bdc8-db4d5993fad1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.588880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.588880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.588880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.588880] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0a189f1-458e-4340-bdc8-db4d5993fad1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.706696] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c2a27e-83db-4022-a129-8e3459a8cda6: rpc.has_security_group_logging(os_id): False [ 1009.729650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.729650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.729650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.729650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.729650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.729650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.729650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.729650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.729917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.730399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.730399] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.730399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.730399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.730558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.731902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.731902] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.731902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.731902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.731902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.731902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.731902] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be created. [ 1009.790337] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.790478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.790532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.790731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.790903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.804729] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1009.828451] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6171fb3b-4b28-4b0b-a1a6-59e802c3aad5 [ 1009.828451] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.828451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.828451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.828451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.828451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.828451] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6171fb3b-4b28-4b0b-a1a6-59e802c3aad5 already deleted. [ 1009.828451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6171fb3b-4b28-4b0b-a1a6-59e802c3aad5" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.090972] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.090972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.090972] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.090972] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0a189f1-458e-4340-bdc8-db4d5993fad1 with status ACTIVE [ 1010.090972] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.090972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.090972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.091347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.091347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.091414] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.091485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.091544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.091710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.091762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.091940] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.094802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.094892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.095043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.095128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.095217] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0a189f1-458e-4340-bdc8-db4d5993fad1 is going to be updated. [ 1010.114968] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.114968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.114968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.114968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.116968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.118842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0a189f1-458e-4340-bdc8-db4d5993fad1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.331918] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1010.332124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.332333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.332493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.332673] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.332789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.332855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.333010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.333099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.333192] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.600216] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.837488] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.104329] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.104329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.104329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.104882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.104882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.104882] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 1011.106444] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1011.106635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.133948] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.134595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.134595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.134595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.134595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.143121] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 1011.339028] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.407402] env[70287]: INFO networking_nsxv3.common.synchronization [req-935d7a38-ff7a-4faa-aee4-f57143b99ac7 req-c71b7476-5d3a-47fe-ba7f-0c609390ebbc tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1011.407402] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1011.407402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.407402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.407402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.407402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.407402] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.407402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.407402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.407402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.407402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.408553] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.432945] env[70287]: INFO networking_nsxv3.common.synchronization [None req-535b6a9f-6f54-4e39-bab6-5e206c444df4 None None] Enqueued Resource ID: 492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48 with Priority: HIGHEST for action port [ 1011.433447] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48 with Priority: HIGHEST for action port [ 1011.433756] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.434968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.434968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.435267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.435487] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.575117] env[70287]: INFO networking_nsxv3.common.synchronization [req-456e9596-68ec-4898-b36d-b4d6ca25c904 req-1d1a86ea-ee45-4fa7-bf77-cfd45363c2ac tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1011.575345] env[70287]: INFO networking_nsxv3.common.synchronization [req-456e9596-68ec-4898-b36d-b4d6ca25c904 req-1d1a86ea-ee45-4fa7-bf77-cfd45363c2ac tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_members [ 1011.575779] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1011.575906] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_members [ 1011.576400] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.576541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.576608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.576842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.576996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.577126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.577190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.577341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.577422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.577515] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.578348] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0fc6519-bbc4-413a-990c-bec5417d292b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.578453] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.578516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.578715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.578852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.580030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.580030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.580030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.580030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.580030] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.629896] env[70287]: INFO networking_nsxv3.common.synchronization [req-456e9596-68ec-4898-b36d-b4d6ca25c904 req-1d1a86ea-ee45-4fa7-bf77-cfd45363c2ac tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_rules [ 1011.632080] env[70287]: INFO networking_nsxv3.common.synchronization [req-456e9596-68ec-4898-b36d-b4d6ca25c904 req-1d1a86ea-ee45-4fa7-bf77-cfd45363c2ac tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1011.632261] env[70287]: INFO networking_nsxv3.common.synchronization [req-456e9596-68ec-4898-b36d-b4d6ca25c904 req-1d1a86ea-ee45-4fa7-bf77-cfd45363c2ac tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_rules [ 1011.632406] env[70287]: INFO networking_nsxv3.common.synchronization [req-456e9596-68ec-4898-b36d-b4d6ca25c904 req-1d1a86ea-ee45-4fa7-bf77-cfd45363c2ac tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_members [ 1011.632658] env[70287]: INFO networking_nsxv3.common.synchronization [req-456e9596-68ec-4898-b36d-b4d6ca25c904 req-1d1a86ea-ee45-4fa7-bf77-cfd45363c2ac tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: c3732b54-5e41-439b-b520-dd176b893e67 with Priority: HIGHEST for action port [ 1011.633793] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_rules [ 1011.633947] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_rules [ 1011.634090] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3732b54-5e41-439b-b520-dd176b893e67 with Priority: HIGHEST for action port [ 1011.634237] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1011.634366] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_members [ 1011.634796] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.634881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.634930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.635158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.635241] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.642892] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f0fc6519-bbc4-413a-990c-bec5417d292b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.642892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.642892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.642892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.642892] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.642892] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3732b54-5e41-439b-b520-dd176b893e67 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.642892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.642892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.642892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.642892] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3732b54-5e41-439b-b520-dd176b893e67',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.642892] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.642892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.645019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0fc6519-bbc4-413a-990c-bec5417d292b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.645127] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.816650] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1011.817296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.817296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.817445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.817445] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.841040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.841203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.841251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.841454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.841543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.841639] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1011.874614] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.874756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.874825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.875051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.875199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.884081] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1011.911778] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.911963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.912028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.912306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.912411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.912617] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.912716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.912917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.912985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.913025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.913106] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 1011.931039] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.931255] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.931386] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.931649] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.931906] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.932078] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.932216] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.932477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.932648] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.932858] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.933044] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.933202] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.933318] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.933438] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1011.933548] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.933688] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.939719] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48 [ 1011.939906] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.940027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.940098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.940271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.940358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.940448] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48 already deleted. [ 1011.940526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-492ed806-4aa0-4e7e-b1f8-7e0cb3d44d48" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.960798] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.961020] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1011.961174] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.961364] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.961689] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-5165cac6-f622-41ad-80ae-fd1051f28d12 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.961869] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.961994] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.962349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.962508] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5165cac6-f622-41ad-80ae-fd1051f28d12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.964055] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.964171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.964241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.964415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.964546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.972911] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 1012.081641] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.082636] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.146370] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3732b54-5e41-439b-b520-dd176b893e67 with status ACTIVE [ 1012.146702] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.146959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.147043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.147704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.147704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.147704] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.147888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.147888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.147975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.148161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.148906] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.148906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.148906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.148906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.148906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.148906] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3732b54-5e41-439b-b520-dd176b893e67 is going to be updated. [ 1012.150669] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0fc6519-bbc4-413a-990c-bec5417d292b taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.150669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.150669] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.150669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.174020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.174020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.174020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.174020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.174020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.174020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.320210] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.320386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.320456] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.320828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.320910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.320967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.321012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.321169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.321256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.321359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.321564] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.467791] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.467791] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.467791] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.467934] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.468590] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.468590] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 5165cac6-f622-41ad-80ae-fd1051f28d12 not found, creating... [ 1012.468590] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.468780] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.468811] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.470164] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.470356] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.470702] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.470859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.470980] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.471724] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.471724] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.471724] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 5165cac6-f622-41ad-80ae-fd1051f28d12 is going to be created. [ 1012.493438] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.494267] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.494267] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.494267] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.494576] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.494696] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.584906] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.586133] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.823864] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.824289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.824289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.824514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.824739] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.824850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.824924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.825119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.825208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.825292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.825435] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.825525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.825599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.825745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.825881] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.825971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.826068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.826503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.826503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.826503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.826634] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.088419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.088580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.088664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.089033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.089137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.089239] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be updated. [ 1013.090852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.090960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.091041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.091213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.091292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.091380] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0fc6519-bbc4-413a-990c-bec5417d292b is going to be created. [ 1013.123072] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.123072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.123072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.123072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.123072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.126033] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.128164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.128274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.128500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.128644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.130226] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0fc6519-bbc4-413a-990c-bec5417d292b in Status: UNINITIALIZED for 2s [ 1013.135760] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: IN_PROGRESS for 2s [ 1013.159031] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 1013.159431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.159431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.159646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.159835] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.159953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.160029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.160191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.160274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.160369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.160453] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.264170] env[70287]: INFO networking_nsxv3.common.synchronization [req-935d7a38-ff7a-4faa-aee4-f57143b99ac7 req-fd88fa6c-3e4e-4f23-9c5a-7f687f0db73a service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 1013.264454] env[70287]: INFO networking_nsxv3.common.synchronization [req-935d7a38-ff7a-4faa-aee4-f57143b99ac7 req-fd88fa6c-3e4e-4f23-9c5a-7f687f0db73a service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1013.264618] env[70287]: INFO networking_nsxv3.common.synchronization [req-935d7a38-ff7a-4faa-aee4-f57143b99ac7 req-fd88fa6c-3e4e-4f23-9c5a-7f687f0db73a service nova] Enqueued Resource ID: 5165cac6-f622-41ad-80ae-fd1051f28d12 with Priority: HIGHEST for action port [ 1013.265336] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 1013.265481] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1013.265578] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5165cac6-f622-41ad-80ae-fd1051f28d12 with Priority: HIGHEST for action port [ 1013.265863] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.266012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.266172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.266385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.266487] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.267830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.267930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.268139] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-5165cac6-f622-41ad-80ae-fd1051f28d12 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.268243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.268306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.268483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.268559] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5165cac6-f622-41ad-80ae-fd1051f28d12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.330170] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c2a27e-83db-4022-a129-8e3459a8cda6: rpc.has_security_group_logging(os_id): False [ 1013.348818] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.348961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.349717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.349717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.349717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.349717] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.349717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.349717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.349999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.349999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.350191] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.350289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.350338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.350663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.350758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.351199] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.351293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.351353] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.351503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.351602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.351688] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1013.411489] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.411637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.411706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.411929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.412122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.423109] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1013.663394] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.663598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.663659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.663932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.664166] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.664289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.664358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.664530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.664619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.664708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.664857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.664950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.665021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.665195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.665352] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.665450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.665512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.665653] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.665732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.665813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.665905] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.770532] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.770758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.773162] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5165cac6-f622-41ad-80ae-fd1051f28d12 with status ACTIVE [ 1013.773421] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.773607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.773722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.774015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.774166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.774413] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.774572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.774768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.775530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.775530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.775530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.775530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.775788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.775840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.775972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.776147] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5165cac6-f622-41ad-80ae-fd1051f28d12 is going to be updated. [ 1013.797502] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.797634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.797722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.797886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.798025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.798188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5165cac6-f622-41ad-80ae-fd1051f28d12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.899351] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1013.899351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.899351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.899351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.899351] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.899351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.899916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.899916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.899916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.899916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.899916] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.982837] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 1013.983086] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 1013.983238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.983421] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.983646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.984047] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.984218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.984292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.984486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.984613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.984670] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.125360] env[70287]: INFO networking_nsxv3.common.synchronization [req-cf2ae78f-e2d7-4681-a9c0-690948346ca2 req-faf08771-cbef-4292-b5b5-1a6f67d624f3 tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1014.125547] env[70287]: INFO networking_nsxv3.common.synchronization [req-cf2ae78f-e2d7-4681-a9c0-690948346ca2 req-faf08771-cbef-4292-b5b5-1a6f67d624f3 tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_members [ 1014.126149] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1014.126293] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0fc6519-bbc4-413a-990c-bec5417d292b with Priority: HIGHEST for action security_group_members [ 1014.126578] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.126756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.126843] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f0fc6519-bbc4-413a-990c-bec5417d292b taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.126922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.167727] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d: rpc.has_security_group_logging(os_id): False [ 1014.174370] env[70287]: INFO networking_nsxv3.common.synchronization [req-cf2ae78f-e2d7-4681-a9c0-690948346ca2 req-faf08771-cbef-4292-b5b5-1a6f67d624f3 tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_rules [ 1014.174550] env[70287]: INFO networking_nsxv3.common.synchronization [req-cf2ae78f-e2d7-4681-a9c0-690948346ca2 req-faf08771-cbef-4292-b5b5-1a6f67d624f3 tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1014.174697] env[70287]: INFO networking_nsxv3.common.synchronization [req-cf2ae78f-e2d7-4681-a9c0-690948346ca2 req-faf08771-cbef-4292-b5b5-1a6f67d624f3 tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: c3732b54-5e41-439b-b520-dd176b893e67 with Priority: HIGHEST for action port [ 1014.175178] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_rules [ 1014.175311] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1014.175407] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3732b54-5e41-439b-b520-dd176b893e67 with Priority: HIGHEST for action port [ 1014.176252] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.176436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.176699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.176741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.176901] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3732b54-5e41-439b-b520-dd176b893e67 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.177011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.177248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.177470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.177556] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3732b54-5e41-439b-b520-dd176b893e67',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.187247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.187393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.187461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.187652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.187880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.187945] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.189899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.189899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.189899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.189899] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 1014.255406] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.255553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.255742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.255826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.255967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.271035] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 1014.402523] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.402778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.402894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.403250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.403509] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.403671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.403773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.404125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.404271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.404474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.404674] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.404830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.404928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.405169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.405386] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.405530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.405641] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.405836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.406112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.406175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.406314] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.487809] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.680088] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3732b54-5e41-439b-b520-dd176b893e67 with status ACTIVE [ 1014.680332] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.680470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.680540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.681238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.681238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.681238] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.681238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.681238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.681521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.681521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.681656] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.681749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.681812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.682038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.682038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.682127] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3732b54-5e41-439b-b520-dd176b893e67 is going to be updated. [ 1014.704268] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.704436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.704476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.704678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.704808] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.704967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3732b54-5e41-439b-b520-dd176b893e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.918359] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 1014.938764] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.938909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.938989] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.939188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.939275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.939466] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.939560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.939620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.939768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.939835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.940928] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.940928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.940928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.940928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.940928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.940928] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.940928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.940928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.941271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.941271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.941271] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1014.990792] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.021325] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.021468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.021535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.021740] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.021892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.034461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1015.151307] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 1015.152103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.152103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.152103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.152103] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.152407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.152407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.152478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.152528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.153070] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.159981] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f0fc6519-bbc4-413a-990c-bec5417d292b in Status: SUCCESS [ 1015.160226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.160391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.160599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.160780] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.160917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.160997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.161128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.161201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.161304] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.437344] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1015.437420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.437605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.437856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.438056] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.493368] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.493622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.493729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.494122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.494278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.494332] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 1015.526095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.526292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.526376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.526720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.529032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.537915] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 1015.657241] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.663574] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.663775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.663837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.664078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.664173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.664370] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.664484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.664619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.664676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.664756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.664842] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0fc6519-bbc4-413a-990c-bec5417d292b is going to be deleted. [ 1015.698822] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.699409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.699409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.699409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.699526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.699526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.699671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.699822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.699985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.700099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.700162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.700302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.700378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.700543] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.940777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.941038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.941091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.941340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.941587] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.941732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.941842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.941985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.942090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.942181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.942273] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.161733] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.206648] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.206648] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.206648] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0fc6519-bbc4-413a-990c-bec5417d292b already deleted. [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.206648] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.206648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.206648] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.207270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.207270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.208388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.208611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.209373] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.286037] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 1016.286313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.447020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.447020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.447020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.447020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.447020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.447545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.447545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.447545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.447545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.447545] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.665548] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.665548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.665548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.665548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.665548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.665548] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be updated. [ 1016.693496] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.693994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.694211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.694537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.694970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.703838] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: IN_PROGRESS for 2s [ 1016.713960] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f0fc6519-bbc4-413a-990c-bec5417d292b',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.713960] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.713960] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.713960] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f0fc6519-bbc4-413a-990c-bec5417d292b already deleted. [ 1016.713960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.949854] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c2a27e-83db-4022-a129-8e3459a8cda6: rpc.has_security_group_logging(os_id): False [ 1016.966751] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.968643] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.968643] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.968643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.969214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.969214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.974247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.974386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.974459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.974638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.974720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.974830] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1017.057245] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1017.057475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.058807] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.058950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.059112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.059204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.059341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.074090] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1017.215130] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f0fc6519-bbc4-413a-990c-bec5417d292b: rpc.has_security_group_logging(os_id): False [ 1017.236833] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.237113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.237172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.237952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.237952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.237952] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.237952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.237952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.238305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.238305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.238305] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0fc6519-bbc4-413a-990c-bec5417d292b is going to be created. [ 1017.260245] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f0fc6519-bbc4-413a-990c-bec5417d292b], does not exist path=[/infra/domains/default/groups/f0fc6519-bbc4-413a-990c-bec5417d292b]."\n}' [ 1017.260396] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0fc6519-bbc4-413a-990c-bec5417d292b failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f0fc6519-bbc4-413a-990c-bec5417d292b [ 1017.260475] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1017.302502] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.302655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.302770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.303028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.304830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.305239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.305359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.305427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.305598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.305678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.305880] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.305977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.306090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.306264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.306340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.306429] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f0fc6519-bbc4-413a-990c-bec5417d292b is going to be created. [ 1017.323469] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/f0fc6519-bbc4-413a-990c-bec5417d292b], does not exist path=[/infra/domains/default/groups/f0fc6519-bbc4-413a-990c-bec5417d292b]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f0fc6519-bbc4-413a-990c-bec5417d292b [ 1017.323469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f0fc6519-bbc4-413a-990c-bec5417d292b" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.324043] env[70287]: Traceback (most recent call last): [ 1017.324043] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1017.324043] env[70287]: return func(*args, **kwargs) [ 1017.324043] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1017.324043] env[70287]: res.raise_for_status() [ 1017.324043] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1017.324043] env[70287]: raise HTTPError(http_error_msg, response=self) [ 1017.324043] env[70287]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f0fc6519-bbc4-413a-990c-bec5417d292b [ 1017.324043] env[70287]: During handling of the above exception, another exception occurred: [ 1017.324043] env[70287]: Traceback (most recent call last): [ 1017.324043] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1017.324043] env[70287]: listener.cb(fileno) [ 1017.324043] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1017.324043] env[70287]: result = function(*args, **kwargs) [ 1017.324043] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1017.324043] env[70287]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1017.324043] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1017.324043] env[70287]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1017.324043] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1017.324043] env[70287]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1017.324043] env[70287]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1017.324043] env[70287]: res.raise_for_status() [ 1017.324043] env[70287]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1024, in raise_for_status [ 1017.324043] env[70287]: raise HTTPError(http_error_msg, response=self) [ 1017.324043] env[70287]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/f0fc6519-bbc4-413a-990c-bec5417d292b [ 1017.324043] env[70287]: Removing descriptor: 22 [ 1017.389166] env[70287]: INFO networking_nsxv3.common.synchronization [req-ff3f7d3b-a66a-4035-b4cc-00c08dbe0d86 req-b3845bfc-2040-4fe0-9c24-7aa95470ea46 tempest-ServerRescueNegativeTestJSON-514752086 tempest-ServerRescueNegativeTestJSON-514752086-project-member] Enqueued Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 1017.389706] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 with Priority: HIGHEST for action security_group_members [ 1017.390010] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-3fe525ed-6fed-4da6-b1de-de2234e26337 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.390148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.390592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.390799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.390964] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.391080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.391143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.391347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.391413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.391480] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3fe525ed-6fed-4da6-b1de-de2234e26337',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.551447] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.551447] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.551447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.551447] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.896241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.896241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.896241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.896241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.916975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.916975] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.916975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.916975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.916975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.916975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.916975] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 is going to be updated. [ 1017.943519] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.943519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.943519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.943519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.943519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.952773] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: IN_PROGRESS for 2s [ 1018.055981] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.056253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.056351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.056553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.056730] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.056979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.056979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.057117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.057166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.057306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.057562] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.057712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.058481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.058802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.058991] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.059191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.059283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.059493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.059597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.059688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.059845] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.140796] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3cb2f4-e1c0-4349-a809-368dd9a33152 req-67a40e2c-bc94-4a6c-9ecc-1656aad8197d tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_members [ 1018.141427] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_members [ 1018.141788] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f041a33f-3065-4123-b535-0695dd2dbb6f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.141893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.142020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.146053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.146328] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.146419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.146466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.146648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.146751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.146849] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.563068] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e5e0f30-956b-4713-b190-79d66c86985e: rpc.has_security_group_logging(os_id): False [ 1018.581257] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.581410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.581551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.581782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.613620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.613895] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.614051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.614125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.614340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.614414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.614615] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.614705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.614760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.614896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.614966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.615181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.615290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.615348] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.617018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.617018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.617018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 1018.651954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.654233] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.654233] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f041a33f-3065-4123-b535-0695dd2dbb6f already deleted. [ 1018.654233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.677146] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.677324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.677392] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.677628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.677725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.690702] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 1018.713580] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 1018.714070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.714070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.714269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.714551] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.714681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.714749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.714916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.714997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.715100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.715202] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.718511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.718676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.718832] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.718962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.719072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.719238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.719347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.719469] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.088454] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1019.088758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.139886] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.139886] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.139886] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.139886] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.139886] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.139886] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.139886] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.139886] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.139886] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.139886] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.139886] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.139886] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.139886] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.140429] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1019.140429] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.140429] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.163455] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.164114] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1019.164114] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.164114] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.164365] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-a552ba3b-80b7-43cd-9fed-becca77a25d6 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.164594] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.164689] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.165020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.165172] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a552ba3b-80b7-43cd-9fed-becca77a25d6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.219251] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.219637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.226446] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.668291] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.668599] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.672040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.672040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.672040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.672040] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port a552ba3b-80b7-43cd-9fed-becca77a25d6 not found, creating... [ 1019.672040] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.672040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.672040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.672040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.672040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.672040] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.672455] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.672455] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.672455] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.672455] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.672455] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: a552ba3b-80b7-43cd-9fed-becca77a25d6 is going to be created. [ 1019.692256] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.692499] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.692763] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.692900] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.693607] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.693607] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.730414] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.963658] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 in Status: SUCCESS [ 1019.963845] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3fe525ed-6fed-4da6-b1de-de2234e26337 deletion is rescheduled due to dependency. [ 1019.963958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3fe525ed-6fed-4da6-b1de-de2234e26337" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.233036] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.233318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.233318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.233494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.233583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.233680] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be updated. [ 1020.264467] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.264909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.264909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.264909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.264909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.273428] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: IN_PROGRESS for 2s [ 1020.704820] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 1020.705079] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.708648] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3cb2f4-e1c0-4349-a809-368dd9a33152 req-e855e513-2b9c-44c3-970e-3f4c8033ceb3 service nova] Enqueued Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_rules [ 1020.708825] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3cb2f4-e1c0-4349-a809-368dd9a33152 req-e855e513-2b9c-44c3-970e-3f4c8033ceb3 service nova] Enqueued Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_members [ 1020.708963] env[70287]: INFO networking_nsxv3.common.synchronization [req-0b3cb2f4-e1c0-4349-a809-368dd9a33152 req-e855e513-2b9c-44c3-970e-3f4c8033ceb3 service nova] Enqueued Resource ID: a552ba3b-80b7-43cd-9fed-becca77a25d6 with Priority: HIGHEST for action port [ 1020.709552] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_rules [ 1020.709552] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_members [ 1020.709552] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a552ba3b-80b7-43cd-9fed-becca77a25d6 with Priority: HIGHEST for action port [ 1020.709939] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f041a33f-3065-4123-b535-0695dd2dbb6f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.710067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.710141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.710340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.710415] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.711371] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f041a33f-3065-4123-b535-0695dd2dbb6f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.711491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.711545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.711699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.711840] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.712661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.712661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.712661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.712661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.712661] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.717625] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-a552ba3b-80b7-43cd-9fed-becca77a25d6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.717625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.717625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.717625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.717625] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a552ba3b-80b7-43cd-9fed-becca77a25d6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.767350] env[70287]: INFO networking_nsxv3.common.synchronization [req-7305a46d-234a-426c-ad0e-395011de08c1 req-a3c5c8bf-76de-42ff-9c6b-72c893931cbc tempest-ServerAddressesNegativeTestJSON-1676929907 tempest-ServerAddressesNegativeTestJSON-1676929907-project-member] Enqueued Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_members [ 1020.767350] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_members [ 1020.767898] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.767898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.767898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.768257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.768399] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.768498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.768498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.768623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.768703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.768794] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.222231] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f041a33f-3065-4123-b535-0695dd2dbb6f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.222415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.222624] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.223695] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a552ba3b-80b7-43cd-9fed-becca77a25d6 with status ACTIVE [ 1021.223843] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.223843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.223919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.224454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.224454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.224454] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.224596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.224596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.224754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.224854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.225017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.225365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.225605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.226350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.226350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.226350] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a552ba3b-80b7-43cd-9fed-becca77a25d6 is going to be updated. [ 1021.248637] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.248991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.248991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.249068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.249210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.249430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a552ba3b-80b7-43cd-9fed-becca77a25d6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.263682] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.263682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.263682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.263682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.263682] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.263682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.263682] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.264022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.264022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.266521] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.266659] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.266775] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.266888] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.267015] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1021.267217] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.267630] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.270839] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.270929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.270929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.271428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.271428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.271428] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.271428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.271604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.271638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.271749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.271793] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e already deleted. [ 1021.271867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.286609] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.286609] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1021.286735] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.286833] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-920" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.287211] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-975e50ef-5d5e-4611-86f0-4d298b14f6e0 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.287425] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.287552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.287845] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.287978] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('975e50ef-5d5e-4611-86f0-4d298b14f6e0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.730810] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.791313] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.793254] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.793945] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.794341] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.794486] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.794672] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 975e50ef-5d5e-4611-86f0-4d298b14f6e0 not found, creating... [ 1021.795072] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.795270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.795398] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.795696] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.795888] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.796246] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.796418] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.796540] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.796761] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.797415] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.797415] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 975e50ef-5d5e-4611-86f0-4d298b14f6e0 is going to be created. [ 1021.816914] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.817157] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.817280] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.817550] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.817858] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.818105] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.236377] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.236617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.236749] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.237864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.237864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.237864] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f041a33f-3065-4123-b535-0695dd2dbb6f is going to be created. [ 1022.270985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.271299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.271335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.271626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.271879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.285271] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 1022.285491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.285650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.285850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.286363] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.286531] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.286578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.286901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.286901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.286901] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.288749] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f041a33f-3065-4123-b535-0695dd2dbb6f in Status: UNINITIALIZED for 2s [ 1022.659743] env[70287]: INFO networking_nsxv3.common.synchronization [req-7305a46d-234a-426c-ad0e-395011de08c1 req-9e433e90-6b26-46a2-960d-368718166b0e service nova] Enqueued Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_rules [ 1022.661610] env[70287]: INFO networking_nsxv3.common.synchronization [req-7305a46d-234a-426c-ad0e-395011de08c1 req-9e433e90-6b26-46a2-960d-368718166b0e service nova] Enqueued Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_members [ 1022.661610] env[70287]: INFO networking_nsxv3.common.synchronization [req-7305a46d-234a-426c-ad0e-395011de08c1 req-9e433e90-6b26-46a2-960d-368718166b0e service nova] Enqueued Resource ID: 975e50ef-5d5e-4611-86f0-4d298b14f6e0 with Priority: HIGHEST for action port [ 1022.661610] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_rules [ 1022.661610] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_members [ 1022.661610] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 975e50ef-5d5e-4611-86f0-4d298b14f6e0 with Priority: HIGHEST for action port [ 1022.661610] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09ec1027-1b0d-4599-b91d-8dcf34cbb08e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.661610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.661610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.662021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.662021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.662568] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.662687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.662753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.662922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.663081] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.663218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.663249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.663409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.663496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.663580] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.667644] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-975e50ef-5d5e-4611-86f0-4d298b14f6e0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.667644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.667644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.667644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.667644] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('975e50ef-5d5e-4611-86f0-4d298b14f6e0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.789912] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.168336] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.168336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.168336] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.172484] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 975e50ef-5d5e-4611-86f0-4d298b14f6e0 with status ACTIVE [ 1023.172484] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.172484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.172484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.172662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.172694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.172860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.172961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.173085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.173258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.173341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.173560] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.174223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.174223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.174223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.174223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.174493] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 975e50ef-5d5e-4611-86f0-4d298b14f6e0 is going to be updated. [ 1023.196753] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.196915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.196958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.197179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.197325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.197502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-975e50ef-5d5e-4611-86f0-4d298b14f6e0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.293674] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.676484] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.795917] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.796480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.796480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.797623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.797623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.797623] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be updated. [ 1023.824326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.825589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.825589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.825589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.825589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.833766] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: IN_PROGRESS for 2s [ 1024.182264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.182264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.182264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.182264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.182264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.182264] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e is going to be created. [ 1024.231194] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.231194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.231194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.231194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.231194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.239109] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e in Status: UNINITIALIZED for 2s [ 1024.300292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f041a33f-3065-4123-b535-0695dd2dbb6f in Status: SUCCESS [ 1024.300624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.300681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.300900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.301114] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.301231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.301291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.301455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.301540] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.301625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.301731] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.634770] env[70287]: INFO networking_nsxv3.common.synchronization [req-4d7a449a-7c4c-4fcf-8b8d-19ea6a04706f req-27ec22ed-7224-4d44-adb1-831cee435878 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1024.635525] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1024.635701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.636217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.636217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.636376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.636521] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.636631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.636690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.636847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.636948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.637045] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.804552] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.140118] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.301688] env[70287]: INFO networking_nsxv3.common.synchronization [req-df45719e-f171-4643-882e-94b3a8dfa8ff req-ce2e68f4-579c-421f-99a2-0e451755ba7c tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 1025.302255] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGHEST for action security_group_members [ 1025.302561] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.302696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.302736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.302931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.306559] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.306705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.306782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.306967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.307070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.308942] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.308942] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f041a33f-3065-4123-b535-0695dd2dbb6f: rpc.has_security_group_logging(os_id): False [ 1025.326258] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.326428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.326518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.326739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.326854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.327128] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.327227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.327341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.327546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.327659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.327800] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f041a33f-3065-4123-b535-0695dd2dbb6f is going to be created. [ 1025.381346] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.381504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.381504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.381652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.381917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.390857] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f041a33f-3065-4123-b535-0695dd2dbb6f in Status: IN_PROGRESS for 2s [ 1025.647072] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.812883] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.812883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.812883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.812883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.849532] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.852019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.852019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.852019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.852019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.852706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.852933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.853277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.853521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.853961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.854347] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.860059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.860059] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.860059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.860059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.860059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.860059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.860059] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 is going to be updated. [ 1025.900034] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.900034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.900034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.900034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.900034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.915220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: IN_PROGRESS for 2s [ 1026.111955] env[70287]: INFO networking_nsxv3.common.synchronization [req-30f2259d-a081-4648-af18-1eec547a6420 req-177af253-a80c-46b0-bd06-7497994d2443 tempest-ServerRescueTestJSONUnderV235-260420745 tempest-ServerRescueTestJSONUnderV235-260420745-project-member] Enqueued Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1026.112596] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 with Priority: HIGHEST for action security_group_members [ 1026.112939] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.118280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.118397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.118737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.118956] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.119268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.119366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.119561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.119678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.119893] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.146974] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.147707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.149539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.149837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.150082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.150212] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1026.187221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.187593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.187712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.187946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.188158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.202720] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1026.256047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e in Status: SUCCESS [ 1026.256561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.256561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.256784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.257000] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.258404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.258404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.258404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.258404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.258404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.258404] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.360183] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095: rpc.has_security_group_logging(os_id): False [ 1026.380665] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.380665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.380948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.380948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.404636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.405552] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.405552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.405552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.405812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.405937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.406775] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.406775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.406775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.407059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.407059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.407157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.407220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.407262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.407416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.408087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.408087] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be updated. [ 1026.467079] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.467292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.467372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.467608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.468132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.488220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: IN_PROGRESS for 2s [ 1026.624622] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.624780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.624869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.625849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.625849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.625849] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.625849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.625849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.626152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.626152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.626310] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be updated. [ 1026.658726] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.658863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.658967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.659159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.659309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.671475] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: IN_PROGRESS for 2s [ 1026.763165] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.763367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.763437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.763658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.763824] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.763944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.763983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.764144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.764243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.764393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.764486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.764552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.764647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.764748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.764976] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.764976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.765093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.765209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.765265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.765310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.766071] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.267188] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09ec1027-1b0d-4599-b91d-8dcf34cbb08e: rpc.has_security_group_logging(os_id): False [ 1027.284384] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.284529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.284597] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.284807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.284895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.285125] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.285223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.285284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.285436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.285510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.285679] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.285768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.285825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.285964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.286046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.286267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.286365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.286423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.286563] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.286645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.286728] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e is going to be created. [ 1027.350879] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.351044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.351113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.351321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.351495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.362252] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e in Status: IN_PROGRESS for 2s [ 1027.399740] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f041a33f-3065-4123-b535-0695dd2dbb6f in Status: SUCCESS [ 1027.399960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.542788] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.543017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.543129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.543386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.543524] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.832679] env[70287]: INFO networking_nsxv3.common.synchronization [req-482e0b8e-53ba-4927-9cce-595b895b4a75 req-91641609-5b0d-4a6c-910f-cb0aab359cfb tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 1027.834058] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 1027.834598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.834875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.835074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.835500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.835814] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.836075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.836285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.836640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.836836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.837033] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.928143] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae697c95-678e-4288-aec7-3a6fe1dee306 in Status: SUCCESS [ 1027.928143] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 deletion is rescheduled due to dependency. [ 1027.928143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.045887] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.211786] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1028.211979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.339779] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.501764] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 1028.502054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.502733] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.502946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.503047] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81c69c3a-0cc1-48d7-9d97-d2dc24f7a095',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.549377] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.684034] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 in Status: SUCCESS [ 1028.684034] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 deletion is rescheduled due to dependency. [ 1028.684034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.723269] env[70287]: INFO networking_nsxv3.common.synchronization [req-31f9ef20-f8d0-455e-9823-7c9916fb1c49 req-7afd1f2f-6a16-47fe-8c20-dec2bf5e9584 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1028.725423] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1028.725423] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.725423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.725423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.725423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.725423] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.725423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.725423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.725423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.725423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.725423] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.843710] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.868582] env[70287]: INFO networking_nsxv3.common.synchronization [req-a5c5a101-6103-4698-8bb4-631ccbe43ce4 req-be1dd1a0-2b21-4607-b3b7-dd6ec8cb4de4 tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1028.869088] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1028.869392] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.869521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.869599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.869798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.870516] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.870516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.870516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.870516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.870516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.870516] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.029265] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.029265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.029265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.029426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.029426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.029531] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81c69c3a-0cc1-48d7-9d97-d2dc24f7a095 is going to be deleted. [ 1029.053095] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1029.053198] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1029.084881] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.085049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.085120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.085425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.085534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.085659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81c69c3a-0cc1-48d7-9d97-d2dc24f7a095" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.227406] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.227513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.227588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.227807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.248980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.249272] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.249393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.249461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.249658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.249741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.250369] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be updated. [ 1029.275795] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.275795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.275795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.275795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.275795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.286407] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: IN_PROGRESS for 2s [ 1029.346129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.346324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.346421] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.346612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.346717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.346800] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be updated. [ 1029.375958] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.376790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.376862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.377104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.377193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.377406] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.377506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.377565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.377707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.377779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.377869] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 1029.382068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.382243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.382346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.382569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.382869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.385285] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e in Status: SUCCESS [ 1029.385374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.394821] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 2s [ 1029.412471] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.412621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.412692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.412902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.413050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.422246] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 1029.852021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.852021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.852021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.852021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.864070] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1029.865675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.867272] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1029.905753] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.905753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.905753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.905753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.916296] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.917214] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1029.917434] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1029.917642] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1029.958874] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.962184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.962280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.962488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.963703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.963928] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1030.043343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.043717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.043877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.044264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.046013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.046013] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1030.121496] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.121496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.121496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.121496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.121790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.121995] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:52. [ 1030.121995] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f', 'a4de514c-a329-428e-aef2-824011ac27e1', '33f97a48-67cf-4681-a4ae-50c22c693573', 'aafb90fc-938c-44be-9296-60863884f367', '84f1f591-bba8-479c-a2de-cf9524dceb77', '521389fe-7ad3-45db-944a-1438ff593c45', 'd3161f57-5a3e-445b-998a-3e587c1ae1d7', '68e57bed-6bad-4f87-86dc-05486c964c31', '3c4fea80-b8d6-423e-9f82-93c6ef731d08', '9e5344b0-d8f6-49cd-abc4-1a415b3aa399', '7e5e0f30-956b-4713-b190-79d66c86985e', 'a986e1a5-6b8e-4d48-9768-decfdf0f10ae', 'd6c2a27e-83db-4022-a129-8e3459a8cda6', '96287f57-8a87-4086-ac4e-214b416b0677', '103dc013-133c-4ce6-897f-dbfb9383e30c', '4192632d-6c01-4f54-972c-1e52156ebf12', 'e9d742c4-fcbc-4b69-9949-6ee5386d29e2', 'b2d197f8-6ecf-4737-ae78-a66d15978937', '6dd050a9-748f-4acb-8e46-7e66c72189cc', 'fab56e40-0f11-4047-a55f-7256f2c35ef8', 'df66c1e2-6914-41c1-a5ac-eb133438cab6', '7fa9a372-83e3-4430-bfa3-b4320a4cc0fe', '3fa85bd5-519a-4ab3-885c-dd87b56fc10a', 'd87c2dce-8258-430c-b549-6c6bfe5f0943', '66c1d37b-c5db-46f6-a3a7-fba9859cd91e', '1bd48e89-cc58-4469-862d-723098d8ef49', '046d93ea-504a-4a85-9ee9-25113ed9b167', '10ebe6dc-47f0-434b-95e1-44ef22b9a387', 'aace6632-4a31-4f49-8463-d0be4cce8713', '6e14022e-50e8-464a-97d9-95650f41cb7b', 'ac98ad7d-21c7-4c9e-add9-9d7467bf4897', '00cd6f54-b66d-4d65-84a8-02e8042ea31d', 'c7801a11-9fa5-48e7-852a-cce31e8a5030', '3e02cb19-0821-42f3-a922-f67afc4bab0d', '09ec1027-1b0d-4599-b91d-8dcf34cbb08e', '306ade67-3f30-492d-a51d-d4eb542da01d', '3fe525ed-6fed-4da6-b1de-de2234e26337', '03f7a97c-14e5-4707-a109-e07660e131ff', 'eed43c9b-e09e-4fd2-87aa-ee48b0ab6706', 'e268cb7c-d939-4cae-9df0-54709ed24656', 'f23e3805-622c-45be-b03e-1e0963f7a65e', 'f041a33f-3065-4123-b535-0695dd2dbb6f', 'ae697c95-678e-4288-aec7-3a6fe1dee306', 'e6ce8eb0-1f95-4fbe-ad32-829aa60405a9', '0c8498fc-c714-4100-81f9-c85ac268aab7', 'b7e1295d-86bf-45fa-b2c1-808d7d01f3ea', 'eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40', '6e412cd2-d48e-4d56-bb8c-6bca0756dff0', 'ea613e25-cc1d-4b11-9ac5-2be1d0651607', '6326b8c2-c4f1-4b56-863e-ab5aeeaf035d', '35b6a470-77b3-4223-87b5-475c69bf4519', '02bff0b8-b4e7-47de-bf5e-9f794b64958a'} {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1030.122204] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1030.150701] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.150701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.150701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.150701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.150701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.150701] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1030.150701] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1030.150701] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1030.255858] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.255858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.255858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.255858] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.258640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.259099] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1030.259172] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1030.259247] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1030.259311] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1030.259387] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/52 resources of Type:Security Group Rules [ 1030.259455] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGH for action security_group_rules [ 1030.259529] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGH for action security_group_rules [ 1030.259592] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGH for action security_group_rules [ 1030.259652] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGH for action security_group_rules [ 1030.259710] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGH for action security_group_rules [ 1030.260217] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGH for action security_group_rules [ 1030.260504] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGH for action security_group_rules [ 1030.260504] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGH for action security_group_rules [ 1030.260504] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGH for action security_group_rules [ 1030.260504] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGH for action security_group_rules [ 1030.260504] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGH for action security_group_rules [ 1030.260629] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGH for action security_group_rules [ 1030.260657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.297076] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: SUCCESS [ 1031.297385] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 deletion is rescheduled due to dependency. [ 1031.299583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.405118] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 1031.405118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.430497] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 1031.431373] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 1031.431527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.093836] env[70287]: INFO networking_nsxv3.common.synchronization [None req-5b8dba2a-00e1-414c-9202-613daaaddd42 tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1033.094554] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1033.094725] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGH for action security_group_rules [ 1033.094833] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33f97a48-67cf-4681-a4ae-50c22c693573 with Priority: HIGH for action security_group_rules [ 1033.094948] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 with Priority: HIGH for action security_group_rules [ 1033.096085] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103dc013-133c-4ce6-897f-dbfb9383e30c with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96287f57-8a87-4086-ac4e-214b416b0677 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4192632d-6c01-4f54-972c-1e52156ebf12 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e57bed-6bad-4f87-86dc-05486c964c31 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4de514c-a329-428e-aef2-824011ac27e1 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aafb90fc-938c-44be-9296-60863884f367 with Priority: HIGH for action security_group_rules [ 1033.100021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.100021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.100021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.100021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.100021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.100021] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.100021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.100021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.100021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.101355] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.103295] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33f97a48-67cf-4681-a4ae-50c22c693573 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.104562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.104562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.104562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.104562] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33f97a48-67cf-4681-a4ae-50c22c693573',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.105158] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.105422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.105593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.105963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.106164] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3161f57-5a3e-445b-998a-3e587c1ae1d7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.108538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-103dc013-133c-4ce6-897f-dbfb9383e30c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.108538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.108538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.108538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.108538] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('103dc013-133c-4ce6-897f-dbfb9383e30c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.108538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.108538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.108538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.109067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.109067] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.109620] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dd050a9-748f-4acb-8e46-7e66c72189cc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.109620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.109771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.109806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.111407] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dd050a9-748f-4acb-8e46-7e66c72189cc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.111407] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.111407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.111407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.111407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.111407] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.112179] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.116030] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e9d742c4-fcbc-4b69-9949-6ee5386d29e2',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.116030] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96287f57-8a87-4086-ac4e-214b416b0677 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.116030] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96287f57-8a87-4086-ac4e-214b416b0677',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.116030] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4192632d-6c01-4f54-972c-1e52156ebf12 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.116030] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4192632d-6c01-4f54-972c-1e52156ebf12',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.116030] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.116030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.116030] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.116919] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.117063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.117145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.117315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.117402] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a986e1a5-6b8e-4d48-9768-decfdf0f10ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.118201] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.118414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.118511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.118686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.118775] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.119498] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.119627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.119708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.119878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.119970] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5344b0-d8f6-49cd-abc4-1a415b3aa399',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.120697] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.120840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.120924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.121104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.121199] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c4fea80-b8d6-423e-9f82-93c6ef731d08',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.121994] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.122136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.122218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.122391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.122480] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.123194] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68e57bed-6bad-4f87-86dc-05486c964c31 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.123325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.123409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.123563] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.123630] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68e57bed-6bad-4f87-86dc-05486c964c31',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.125756] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.125900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.125984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.126178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.126248] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.127234] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4de514c-a329-428e-aef2-824011ac27e1 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.127394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.127477] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.127638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.127722] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4de514c-a329-428e-aef2-824011ac27e1',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.128597] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aafb90fc-938c-44be-9296-60863884f367 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.128730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.128847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.129067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.129160] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aafb90fc-938c-44be-9296-60863884f367',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.129396] env[70287]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 1033.250365] env[70287]: INFO networking_nsxv3.common.synchronization [None req-82e1f31a-2d63-4304-9d1b-a2f2c08d13b0 tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1033.251267] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1033.251604] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.251736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.650519] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.650687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.650759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.650960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.651162] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.651265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.651328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.651475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.651559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.651643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.651728] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.656986] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.656986] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.656986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.656986] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.661418] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.661418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.661418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.661418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.661418] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.661418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.661418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.661970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.661970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.661970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.661970] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.663422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.663617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.663653] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.664289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.664453] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.664552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.664616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.664757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.664834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.665112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.665196] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.667609] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.667717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.667802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.667929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.668083] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.668174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.668232] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.668364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.668440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.668557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.668598] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.671149] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.671149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.671149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.671149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.671149] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.671149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.671149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.671149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.671403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.671435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.671527] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.716596] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.716737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.716798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.716999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.719595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.719697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.721066] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.721171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.722009] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.722105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.722730] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.722823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.723801] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.723917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.724289] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.724369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.726816] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.726916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.888102] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.888102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.888102] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.888102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.888102] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.888102] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.889177] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.889741] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.890033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.891550] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.892062] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.892778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.893243] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.893774] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.894000] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.895258] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.895258] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.895258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.898168] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1033.898168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.898168] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68e57bed-6bad-4f87-86dc-05486c964c31 is going to be deleted. [ 1033.898905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.899227] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.918631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.918631] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 103dc013-133c-4ce6-897f-dbfb9383e30c is going to be deleted. [ 1033.918631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.918631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.947833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.947833] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a986e1a5-6b8e-4d48-9768-decfdf0f10ae is going to be deleted. [ 1033.947833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.947833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.954705] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.955277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.970261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.970261] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4de514c-a329-428e-aef2-824011ac27e1 is going to be deleted. [ 1033.970261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.970261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.984918] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.985138] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.002340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.002340] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3161f57-5a3e-445b-998a-3e587c1ae1d7 is going to be deleted. [ 1034.002340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.002340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.016079] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.016265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.030357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.030482] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33f97a48-67cf-4681-a4ae-50c22c693573 is going to be deleted. [ 1034.031406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.031624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.095421] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.095788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.109112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.109166] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96287f57-8a87-4086-ac4e-214b416b0677 is going to be deleted. [ 1034.111018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.111018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.111018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.111018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 already deleted. [ 1034.111018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.111018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.112326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.113179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.113357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.113446] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.135087] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.135818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.163943] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.168410] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.168522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.168770] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.168879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.168945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.169164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.169312] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.169410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.169473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.169618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.169710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.169817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.169979] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.170104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.170165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.170311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.170444] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.170535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.170594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.170729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.170804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.170883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.170968] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.171802] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.173618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.173733] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.173800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.173956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.174162] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.174256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.174321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.174460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.174537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.174617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.174764] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.174869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.174951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.175111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.175247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.175337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.175404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.175621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.175621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.175697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.175743] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.176920] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.177827] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.177936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.178010] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.178233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.178342] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.178441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.178502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.178651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.178723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.178804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.178942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.179043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.179489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.179489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.179489] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.179647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.179647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.179708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.179768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.179843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.179913] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.191351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.191351] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c4fea80-b8d6-423e-9f82-93c6ef731d08 is going to be deleted. [ 1034.192166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.192372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.218155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.218290] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5344b0-d8f6-49cd-abc4-1a415b3aa399 is going to be deleted. [ 1034.219218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.219449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.292890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.292890] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aafb90fc-938c-44be-9296-60863884f367 is going to be deleted. [ 1034.295796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.295796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.298396] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.298533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.302013] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.302133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.339784] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.339986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.346980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.347130] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be deleted. [ 1034.348026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.348241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.413181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.413324] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4192632d-6c01-4f54-972c-1e52156ebf12 is going to be deleted. [ 1034.414226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.414948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.428457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.428608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.449081] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.449227] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e9d742c4-fcbc-4b69-9949-6ee5386d29e2 is going to be deleted. [ 1034.450139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.450354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.452321] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.452429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.521665] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.521788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.530092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.530092] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dd050a9-748f-4acb-8e46-7e66c72189cc is going to be deleted. [ 1034.531023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.531023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.531171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.531171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68e57bed-6bad-4f87-86dc-05486c964c31" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.531368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.531459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.531535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.531652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-103dc013-133c-4ce6-897f-dbfb9383e30c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.532295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.532459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.532542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.532660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a986e1a5-6b8e-4d48-9768-decfdf0f10ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.532782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.532935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.532997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.533115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4de514c-a329-428e-aef2-824011ac27e1" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.533238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.533374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.533450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.533958] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3161f57-5a3e-445b-998a-3e587c1ae1d7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.534101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.534256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.534342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.534445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33f97a48-67cf-4681-a4ae-50c22c693573" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.534564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.534686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.534751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.534865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96287f57-8a87-4086-ac4e-214b416b0677" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.534983] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.535142] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.535216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.535325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c4fea80-b8d6-423e-9f82-93c6ef731d08" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.535546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.535682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.535754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.535862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5344b0-d8f6-49cd-abc4-1a415b3aa399" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.535996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.536140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.536213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.536388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aafb90fc-938c-44be-9296-60863884f367" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.536547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.536643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.536711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.536816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.536935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.537088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.537161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.537267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4192632d-6c01-4f54-972c-1e52156ebf12" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.610758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.610916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.610988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.611212] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.611306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.611593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e9d742c4-fcbc-4b69-9949-6ee5386d29e2" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.662404] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.662553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.662625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.662842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.662932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.663069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dd050a9-748f-4acb-8e46-7e66c72189cc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.664839] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.664919] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.664987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.665165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.665248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.665333] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 already deleted. [ 1034.665413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.666729] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f: rpc.has_security_group_logging(os_id): False [ 1034.673192] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 1034.674054] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2d197f8-6ecf-4737-ae78-a66d15978937: rpc.has_security_group_logging(os_id): False [ 1034.678096] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6c2a27e-83db-4022-a129-8e3459a8cda6: rpc.has_security_group_logging(os_id): False [ 1034.678535] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 521389fe-7ad3-45db-944a-1438ff593c45: rpc.has_security_group_logging(os_id): False [ 1034.682959] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1f591-bba8-479c-a2de-cf9524dceb77: rpc.has_security_group_logging(os_id): False [ 1034.698122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.699420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.699420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.699420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.708982] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.709119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.709870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.709990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.715141] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.715231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.745573] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.745689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.746579] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.746683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.758155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.758373] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.758483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.758545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.759482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.759574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.759889] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.759999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.760073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.760234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.760308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.760514] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.760593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.760652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.760812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.760893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.760988] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1034.762112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.762277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.820115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.820338] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.820445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.820501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.821280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.821280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.821280] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1034.822244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.823100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.889790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.890133] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.890231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.890297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.890608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.890694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.890962] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be updated. [ 1034.892143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.892341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.895339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.895515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.917900] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.917900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.918818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.918818] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.918943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.918943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.919214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.919214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.919421] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.919509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.919688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.919741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.919780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.919957] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.920386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.920386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.920483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.920483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.920595] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1034.921673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.921891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.963051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.965271] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.965427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.965486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.965717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.965809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.966037] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.966151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.966224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.966409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.966497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.966669] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.966797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.966797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.966945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.967027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.967106] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1034.968195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.968364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.968509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.969521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.969708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.969873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.970777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.971187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.000299] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1035.000861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1035.010731] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.010856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.012100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.012918] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.013050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.013128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.013359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.013454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.013543] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be updated. [ 1035.016810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.016810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.016810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.066564] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 2s [ 1035.067539] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.067905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.067905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.068082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.068082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.134061] env[70287]: INFO networking_nsxv3.common.synchronization [req-da43ca3e-feb1-4823-929c-d6b3990c60a2 req-a0a29a2e-400e-43fb-83d4-bf56f4a98823 tempest-ServerAddressesNegativeTestJSON-1676929907 tempest-ServerAddressesNegativeTestJSON-1676929907-project-member] Enqueued Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_members [ 1035.134061] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e with Priority: HIGHEST for action security_group_members [ 1035.134270] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.136805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.136805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.136805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.136805] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.136805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.136805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.136805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.136805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.136805] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ec1027-1b0d-4599-b91d-8dcf34cbb08e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.137946] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1035.137946] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.138039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.138494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.138494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.138494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.157785] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.157785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.157785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.158082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.158346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.199679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 1035.212496] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1035.642895] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.642895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.642895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.642895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.663187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.663187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.663187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.663187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.663187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.663187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.663187] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e is going to be updated. [ 1035.687097] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.687249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.687333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.687545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.687678] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.696730] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e in Status: IN_PROGRESS for 2s [ 1036.309342] env[70287]: INFO networking_nsxv3.common.synchronization [req-559741b6-b826-43c9-86e1-0da6ab975bba req-5da7ba24-081a-4e0b-a25d-d424567f5aa4 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1036.309950] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1036.310271] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.310396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.310462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.310653] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.310796] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.310892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.310955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.314018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.314190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.314334] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.817353] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.817660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.817723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.817940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.818046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.818246] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.818346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.818410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.818556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.818638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.818794] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1036.850778] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.850951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.851120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.851251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.851397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.860107] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1037.013467] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1037.013744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.014494] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1037.014663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.080065] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 1037.080379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.153031] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1037.153847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.219011] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 1037.219011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.228217] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1037.228710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.707473] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e in Status: SUCCESS [ 1037.707473] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ec1027-1b0d-4599-b91d-8dcf34cbb08e deletion is rescheduled due to dependency. [ 1037.707473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ec1027-1b0d-4599-b91d-8dcf34cbb08e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.870352] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1038.870684] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f deletion is rescheduled due to dependency. [ 1038.871103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.930783] env[70287]: INFO networking_nsxv3.common.synchronization [req-5577256e-9fa7-46e9-bce7-08c31e8f4ece req-94073b26-5a03-4073-b175-805f8a5669f4 tempest-ListServerFiltersTestJSON-741390594 tempest-ListServerFiltersTestJSON-741390594-project-member] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 1038.931332] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 1038.931650] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.931776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.931838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.934601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.934799] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.934915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.934979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.935169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.935256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.935350] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.438309] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.941436] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.403668] env[70287]: INFO networking_nsxv3.common.synchronization [req-f4602a4f-43a9-4cf6-b31a-4a142a90ded1 req-82ffde39-2584-4bfb-b1b5-3359c596447e tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1040.404233] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1040.404537] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.404663] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.404733] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.404921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.405085] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.405185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.405281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.405389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.405487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.405560] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.446672] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.446832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.447109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.447150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.447290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.447930] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1040.473318] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.473568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.473568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.473981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.474146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.482456] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1040.909255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.909479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.909479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.909886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.939157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.939387] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.939816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.939816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.940058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.940107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.940265] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1040.981121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.981423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.981423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.981542] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.981723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.991646] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1041.571933] env[70287]: INFO networking_nsxv3.common.synchronization [req-47c3b7cd-0295-430b-a5a0-e49c05a32860 req-d83d716b-d3b4-4488-8046-878f3d3d4195 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 1041.572519] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGHEST for action security_group_members [ 1041.572833] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.573053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.573053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.574599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.574599] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.574599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.574599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.574795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.574827] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.574943] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.601702] env[70287]: INFO networking_nsxv3.common.synchronization [None req-73422bd2-dd93-48a7-984e-49001064d366 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_rules [ 1041.602416] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_rules [ 1041.602659] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.602844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.602930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.603373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.603533] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.678595] env[70287]: INFO networking_nsxv3.common.synchronization [None req-96fa1145-f2d6-4fd1-b1d1-fbecc64c6d53 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_rules [ 1041.679072] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_rules [ 1041.679366] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.679467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.079543] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.079857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.079857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.080137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.080208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.080391] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.080513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.080582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.080743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.080821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.080907] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be updated. [ 1042.106631] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.106841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.106911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.107143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.107282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.118251] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 2s [ 1042.126470] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.126629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.126675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.126873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.126961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.127065] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 already deleted. [ 1042.127148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.127284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.127458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.127542] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.492168] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1042.492399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.652035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.652197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.652197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.652364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.652454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.652571] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 already deleted. [ 1042.652664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.001366] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1043.001620] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a deletion is rescheduled due to dependency. [ 1043.001750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.130303] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: IN_PROGRESS for 4s [ 1046.141052] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 521389fe-7ad3-45db-944a-1438ff593c45 in Status: SUCCESS [ 1046.141382] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 deletion is rescheduled due to dependency. [ 1046.141382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.680562] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1046.680663] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1047.205619] env[70287]: INFO networking_nsxv3.common.synchronization [req-1a6d6474-dde4-4cf6-b6b1-36e99ec8216f req-b18a638a-ea8a-486d-8859-aef40dbf1cf5 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1047.206631] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1047.207253] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.207401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.207497] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.207666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.207860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.207959] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.208036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.208203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.208415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.211258] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.492152] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-590 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.492152] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.492330] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.492544] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.492793] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.492949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.493082] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.493310] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.493452] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.493657] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.493784] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.493901] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.494030] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.494118] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1047.494231] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.494362] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1047.512570] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1047.512749] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1047.512889] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1047.513074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-590" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.513386] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-896125ee-8f97-4486-9a9e-dac48c5e7348 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.513559] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.513684] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.514019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.514166] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896125ee-8f97-4486-9a9e-dac48c5e7348',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.715254] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.016458] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.016768] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.017039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.017196] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.017364] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.017578] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 896125ee-8f97-4486-9a9e-dac48c5e7348 not found, creating... [ 1048.017817] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.018039] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.018114] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.018335] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.018475] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.018758] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.018915] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.019042] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.019255] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.019392] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.019539] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 896125ee-8f97-4486-9a9e-dac48c5e7348 is going to be created. [ 1048.037891] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.038119] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.038247] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.038521] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.038755] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.039028] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.220798] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.726823] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.727016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.727082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.727312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.727438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.727595] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1048.733259] env[70287]: INFO networking_nsxv3.common.synchronization [req-1a6d6474-dde4-4cf6-b6b1-36e99ec8216f req-817f8e24-902e-493b-830e-b3d9c1b1c21f service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 1048.733449] env[70287]: INFO networking_nsxv3.common.synchronization [req-1a6d6474-dde4-4cf6-b6b1-36e99ec8216f req-817f8e24-902e-493b-830e-b3d9c1b1c21f service nova] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1048.733591] env[70287]: INFO networking_nsxv3.common.synchronization [req-1a6d6474-dde4-4cf6-b6b1-36e99ec8216f req-817f8e24-902e-493b-830e-b3d9c1b1c21f service nova] Enqueued Resource ID: 896125ee-8f97-4486-9a9e-dac48c5e7348 with Priority: HIGHEST for action port [ 1048.733850] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_rules [ 1048.733980] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1048.734089] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896125ee-8f97-4486-9a9e-dac48c5e7348 with Priority: HIGHEST for action port [ 1048.734709] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.734787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.734856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.735224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.735358] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.736700] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.736883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.737150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-896125ee-8f97-4486-9a9e-dac48c5e7348 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.737322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.737440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.737671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.737796] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896125ee-8f97-4486-9a9e-dac48c5e7348',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.754686] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.754969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.755112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.755370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.755559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.767634] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1049.238032] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.238382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.242797] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 896125ee-8f97-4486-9a9e-dac48c5e7348 with status ACTIVE [ 1049.242981] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.243130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.243198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.243406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.243495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.243669] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.243763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.243824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.243972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.244060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.244238] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.244331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.244389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.244614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.244693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.244777] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 896125ee-8f97-4486-9a9e-dac48c5e7348 is going to be updated. [ 1049.268205] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.268401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.268455] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.268659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.268812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.269035] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896125ee-8f97-4486-9a9e-dac48c5e7348" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.559967] env[70287]: INFO networking_nsxv3.common.synchronization [req-08fed5e2-2ad3-4a2a-a1bb-bd1f09173d61 req-73815d2a-0d14-4f4f-9809-fda5fd13b40f tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1049.560500] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1049.560812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.560936] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.561008] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.561268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.561552] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.561672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.561735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.561890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.561975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.562318] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.064055] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.064220] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.064290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.064518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.064616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.064811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.064904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.064963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.065129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.065199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.065280] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 already deleted. [ 1050.065355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.236110] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.237031] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.237031] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.237031] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.237291] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.237552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.237710] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.237981] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.238703] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.238703] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.238703] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1050.238703] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1050.238703] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1050.239081] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1050.239081] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1050.239081] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1050.259028] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1050.259028] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1050.259028] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1050.261276] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.261276] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-1d5ef292-01cb-426a-a5e6-0e5bef41c756 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.261276] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.261276] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.261276] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.261276] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d5ef292-01cb-426a-a5e6-0e5bef41c756',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.765013] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.765300] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.765485] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.765856] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.766075] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.766288] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 1d5ef292-01cb-426a-a5e6-0e5bef41c756 not found, creating... [ 1050.766636] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.766847] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.767019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.767310] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.767510] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.767858] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.768081] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.768263] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.768532] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.768727] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.768925] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 is going to be created. [ 1050.779487] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1050.779744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.779914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.780162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.780355] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.780503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.780590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.780791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.780897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.781027] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.787534] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.787766] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.787930] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.788185] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.788451] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.788640] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.283750] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.785961] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.036747] env[70287]: INFO networking_nsxv3.common.synchronization [req-08fed5e2-2ad3-4a2a-a1bb-bd1f09173d61 req-ee12f941-e04c-42d6-946b-4842227063a6 service nova] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1052.036950] env[70287]: INFO networking_nsxv3.common.synchronization [req-08fed5e2-2ad3-4a2a-a1bb-bd1f09173d61 req-ee12f941-e04c-42d6-946b-4842227063a6 service nova] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1052.037105] env[70287]: INFO networking_nsxv3.common.synchronization [req-08fed5e2-2ad3-4a2a-a1bb-bd1f09173d61 req-ee12f941-e04c-42d6-946b-4842227063a6 service nova] Enqueued Resource ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 with Priority: HIGHEST for action port [ 1052.037352] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1052.037445] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1052.037552] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 with Priority: HIGHEST for action port [ 1052.038112] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.038238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.038298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.038505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.038579] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.039414] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.039530] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.039599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.039801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.039931] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.040075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.040121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.040230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.040307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.040392] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.041327] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d5ef292-01cb-426a-a5e6-0e5bef41c756 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.045022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.045022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.045022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.045022] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d5ef292-01cb-426a-a5e6-0e5bef41c756',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.288172] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.288515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.288515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.288608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.288718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.288795] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1052.316950] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.317131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.317176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.317370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.317514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.324848] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1052.544376] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.545435] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.545533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.545689] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d5ef292-01cb-426a-a5e6-0e5bef41c756 with status ACTIVE [ 1052.545850] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.545953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.546027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.546229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.546316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.546482] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.546594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.546658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.546810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.546925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.547130] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.547268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.547268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.547409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.547481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.547562] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 is going to be updated. [ 1052.572752] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.572903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.572973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.573195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.573331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.573489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.056456] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.558923] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.559238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.559238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.559352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.559434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.559533] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 is going to be created. [ 1053.583743] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.583889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.583960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.584175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.584329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.592497] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: UNINITIALIZED for 2s [ 1054.335849] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1054.336110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.336279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.336495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.336750] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.336874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.336955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.337165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.337270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.337312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.337403] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.840013] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.840013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.840013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.840512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.840512] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.840512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.840512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.840832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.840889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843484] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.843484] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.843484] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.348824] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fab56e40-0f11-4047-a55f-7256f2c35ef8: rpc.has_security_group_logging(os_id): False [ 1055.369776] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.370265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.370265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.370265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.370367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.370534] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.370658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.370710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.370914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.370996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.371243] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.371341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.371409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.371553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.371645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.371863] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.371962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.372031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.372418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.372508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.373041] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1055.439706] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.439938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.439988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.440207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.440364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.457615] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1055.602219] env[70287]: INFO networking_nsxv3.common.synchronization [None req-60422a8d-ac3c-4426-857d-848a2bd16732 None None] Enqueued Resource ID: 30354e56-8f5d-45b7-b00c-2106f78d1864 with Priority: HIGHEST for action port [ 1055.606024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30354e56-8f5d-45b7-b00c-2106f78d1864 with Priority: HIGHEST for action port [ 1055.606024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-30354e56-8f5d-45b7-b00c-2106f78d1864 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.606024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30354e56-8f5d-45b7-b00c-2106f78d1864" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.606024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30354e56-8f5d-45b7-b00c-2106f78d1864" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.606024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30354e56-8f5d-45b7-b00c-2106f78d1864" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.606024] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30354e56-8f5d-45b7-b00c-2106f78d1864',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.609143] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: SUCCESS [ 1055.609388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.609547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.609751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.609938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.610065] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.610125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.610286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.610367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.610498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.610532] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.107707] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30354e56-8f5d-45b7-b00c-2106f78d1864 [ 1056.109821] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.110523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.110937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.111482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.112846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.112978] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30354e56-8f5d-45b7-b00c-2106f78d1864 already deleted. [ 1056.113146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30354e56-8f5d-45b7-b00c-2106f78d1864" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.113442] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.616895] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d139a12c-73ef-4c1b-a08c-ef24b2ea3b83: rpc.has_security_group_logging(os_id): False [ 1056.635984] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.636104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.636183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.636450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.636565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.636937] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.637069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.637208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.638073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.638073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.638178] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 is going to be created. [ 1056.708599] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.708880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.708880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.710109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.710109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.736534] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: IN_PROGRESS for 2s [ 1057.418931] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7934eefc-9b74-4fdc-b5ba-e72a26f4622d None None] Enqueued Resource ID: d32941aa-e561-4be0-a6bd-5166f4a4f47c with Priority: HIGHEST for action port [ 1057.419626] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d32941aa-e561-4be0-a6bd-5166f4a4f47c with Priority: HIGHEST for action port [ 1057.421049] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d32941aa-e561-4be0-a6bd-5166f4a4f47c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.421049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d32941aa-e561-4be0-a6bd-5166f4a4f47c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.421049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d32941aa-e561-4be0-a6bd-5166f4a4f47c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.421049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d32941aa-e561-4be0-a6bd-5166f4a4f47c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.421049] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d32941aa-e561-4be0-a6bd-5166f4a4f47c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.472011] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1057.472332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.923861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d32941aa-e561-4be0-a6bd-5166f4a4f47c [ 1057.923861] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.923861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.923861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.923861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.923861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.923861] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d32941aa-e561-4be0-a6bd-5166f4a4f47c already deleted. [ 1057.923861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d32941aa-e561-4be0-a6bd-5166f4a4f47c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.749641] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: SUCCESS [ 1058.749934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.424187] env[70287]: INFO networking_nsxv3.common.synchronization [req-28754847-358d-42ac-b6ed-1917095e5fd6 req-9d392e2c-1936-4e1f-b01b-81c1011bf7c8 tempest-ListServerFiltersTestJSON-741390594 tempest-ListServerFiltersTestJSON-741390594-project-member] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 1059.424723] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 1059.425042] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.426155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.430105] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.430374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.430581] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.430696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.430763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.430925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.431021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.431118] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.936299] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.438537] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.547400] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f4deae5e-e8b0-4667-9bb2-7a19a34ab200 tempest-AttachInterfacesTestJSON-1749285580 tempest-AttachInterfacesTestJSON-1749285580-project-member] Enqueued Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 1060.548044] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d with Priority: HIGHEST for action security_group_members [ 1060.548403] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.549583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.549583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.549583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.549583] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.549583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.549583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.549583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.549583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.549583] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6326b8c2-c4f1-4b56-863e-ab5aeeaf035d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.942553] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.942553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.942553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.942553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.942553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.942553] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1060.989110] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.989110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.989110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.989110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.989110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.999555] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1061.052166] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.054510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.054510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.054510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.078017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.078017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.078017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.078017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.078017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.078017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.078017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d is going to be updated. [ 1061.108085] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.108239] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.108291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.108508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.108658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.116572] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 2s [ 1061.437734] env[70287]: INFO networking_nsxv3.common.synchronization [req-684a94d2-bb97-4b54-812b-2da3604dcbc8 req-030d472f-7c88-44d9-be46-09ca902e6fa1 tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1061.438673] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1061.439013] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.439213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.439324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.439624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.439969] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.440186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.440269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.440506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.440645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.440796] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.946975] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.947525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.947599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.947807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.947896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.948095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.948195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.948268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.948391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.948465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.948550] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1061.950838] env[70287]: INFO networking_nsxv3.common.synchronization [req-b15c9480-300f-465a-89a7-0738ab700d97 req-70b5ae53-fcdd-4a40-a8b6-1f5e9527000d tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1061.951367] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1061.952047] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.952165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.952233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.952386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.952599] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.952673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.952707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.952834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.952909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.952995] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.977023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.977023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.977023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.977224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.977224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.985293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1062.454873] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.958571] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.008896] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1063.009143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.126116] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: IN_PROGRESS for 4s [ 1063.233298] env[70287]: INFO networking_nsxv3.common.synchronization [req-2edc2a38-74c7-4e09-89dc-d66033f949f7 req-47d0a161-50fd-4c34-9104-51ec7014fb82 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_members [ 1063.233867] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_members [ 1063.234239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.234385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.234447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.234717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.234926] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.235051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.235110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.235269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.235369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.235484] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.459834] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.460011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.460090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.460299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.460391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.460487] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1063.487799] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.488133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.488133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.488252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.488403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.497118] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1063.577083] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.577295] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.577421] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.577690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.577953] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.578174] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.578310] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.578547] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.578703] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.578906] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.579051] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.579176] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.579290] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.579440] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1063.579639] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.579836] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.599188] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.599188] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1063.599294] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.599403] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.599806] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.600015] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.600146] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.600466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.600610] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af3c1d6c-7a68-4e2a-8ce9-0571a057ce62',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.737870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.738201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.738201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.738454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.738656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.738911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.739093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.739169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.739680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.739680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.739680] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 already deleted. [ 1063.739680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.995213] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1063.995213] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 1063.995626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.106629] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.106629] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 not found, creating... [ 1064.106629] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.106629] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.107270] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.107270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.107270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.107270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.107696] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.107973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 is going to be created. [ 1064.126253] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.126906] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.127201] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.127538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.127902] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.128310] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.816109] env[70287]: INFO networking_nsxv3.common.synchronization [req-2edc2a38-74c7-4e09-89dc-d66033f949f7 req-0d09d6db-ab3b-44eb-b330-099ad17ebd0f service nova] Enqueued Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_rules [ 1064.818807] env[70287]: INFO networking_nsxv3.common.synchronization [req-2edc2a38-74c7-4e09-89dc-d66033f949f7 req-0d09d6db-ab3b-44eb-b330-099ad17ebd0f service nova] Enqueued Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_members [ 1064.818807] env[70287]: INFO networking_nsxv3.common.synchronization [req-2edc2a38-74c7-4e09-89dc-d66033f949f7 req-0d09d6db-ab3b-44eb-b330-099ad17ebd0f service nova] Enqueued Resource ID: af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 with Priority: HIGHEST for action port [ 1064.818807] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_rules [ 1064.818807] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_members [ 1064.818807] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 with Priority: HIGHEST for action port [ 1064.818807] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.818807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.818807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.818807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.818807] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.819248] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.819376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.819443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.819623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.819771] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.819864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.819926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.820083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.820169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.820265] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.821545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.821778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.821852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.822013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.822108] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af3c1d6c-7a68-4e2a-8ce9-0571a057ce62',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.136723] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d in Status: SUCCESS [ 1065.136723] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6326b8c2-c4f1-4b56-863e-ab5aeeaf035d deletion is rescheduled due to dependency. [ 1065.137096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6326b8c2-c4f1-4b56-863e-ab5aeeaf035d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.324105] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.324250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.325611] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.326637] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 with status ACTIVE [ 1065.326769] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.326930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.326968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.327160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.327247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.327413] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.327507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.327617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.327710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.327786] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.328133] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.329802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.330804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.331019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.331111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.331223] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af3c1d6c-7a68-4e2a-8ce9-0571a057ce62 is going to be updated. [ 1065.354996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.354996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.354996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.354996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.354996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.354996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af3c1d6c-7a68-4e2a-8ce9-0571a057ce62" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.391071] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ce5f8c2b-a6ab-471c-b20e-9df3d74ff51b None None] Enqueued Resource ID: feef3aa4-178e-4f21-b854-1129f4d55a50 with Priority: HIGHEST for action port [ 1065.391071] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: feef3aa4-178e-4f21-b854-1129f4d55a50 with Priority: HIGHEST for action port [ 1065.391071] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-feef3aa4-178e-4f21-b854-1129f4d55a50 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.391071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-feef3aa4-178e-4f21-b854-1129f4d55a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.391071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-feef3aa4-178e-4f21-b854-1129f4d55a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.391071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-feef3aa4-178e-4f21-b854-1129f4d55a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.391071] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('feef3aa4-178e-4f21-b854-1129f4d55a50',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.418398] env[70287]: INFO networking_nsxv3.common.synchronization [req-ef16ebcc-d4ba-4359-891c-5f0d7af1a0b6 req-d5c2f96d-01f1-4652-a447-a1f07664a1ae tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1065.418986] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1065.419494] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.419494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.419494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.419822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.419876] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.419985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.420061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.420223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.420310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.420401] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.507192] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1065.507192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.779025] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-396 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.779025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.779025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.779025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.779025] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.779025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.779025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.779025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.779025] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.779025] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.783771] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1065.783771] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1065.783771] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1065.783771] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1065.783771] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1065.783771] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1065.799711] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1065.800124] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1065.802019] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1065.802019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-396" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.802019] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f7802a07-0720-49dc-bd98-f39fe9032e58 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.802019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.802019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.802019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.802019] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7802a07-0720-49dc-bd98-f39fe9032e58',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.834387] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.892281] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port feef3aa4-178e-4f21-b854-1129f4d55a50 [ 1065.892531] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.892670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.892742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.892967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.893083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.893185] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:feef3aa4-178e-4f21-b854-1129f4d55a50 already deleted. [ 1065.893265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-feef3aa4-178e-4f21-b854-1129f4d55a50" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.923620] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.923620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.923620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.923871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.923934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.924334] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.924334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.924334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.924513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.924593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.924679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be deleted. [ 1065.954315] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.954484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.954554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.954771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.954863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.954968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.310985] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.310985] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f7802a07-0720-49dc-bd98-f39fe9032e58 not found, creating... [ 1066.310985] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.310985] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.311859] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.311859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.311859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.311859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.311859] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.311859] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f7802a07-0720-49dc-bd98-f39fe9032e58 is going to be created. [ 1066.331619] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.331817] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.331941] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.332208] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.332433] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.332656] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.336187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.336306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.336373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.336539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.336619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.336708] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 is going to be created. [ 1066.365992] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.366161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.366236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.366385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.366567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.375464] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 in Status: UNINITIALIZED for 2s [ 1067.050723] env[70287]: INFO networking_nsxv3.common.synchronization [req-ef16ebcc-d4ba-4359-891c-5f0d7af1a0b6 req-34798462-7da5-4038-95cf-b87d725bd7ae service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 1067.050867] env[70287]: INFO networking_nsxv3.common.synchronization [req-ef16ebcc-d4ba-4359-891c-5f0d7af1a0b6 req-34798462-7da5-4038-95cf-b87d725bd7ae service nova] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1067.051071] env[70287]: INFO networking_nsxv3.common.synchronization [req-ef16ebcc-d4ba-4359-891c-5f0d7af1a0b6 req-34798462-7da5-4038-95cf-b87d725bd7ae service nova] Enqueued Resource ID: f7802a07-0720-49dc-bd98-f39fe9032e58 with Priority: HIGHEST for action port [ 1067.051687] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_rules [ 1067.051868] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1067.051984] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7802a07-0720-49dc-bd98-f39fe9032e58 with Priority: HIGHEST for action port [ 1067.053976] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.054141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.054208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.054472] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.054573] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.056017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.056148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.056222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.056425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.056587] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.056747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.056815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.056957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.059015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.059147] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.063560] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7802a07-0720-49dc-bd98-f39fe9032e58 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.063782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.063782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.063987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.064086] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7802a07-0720-49dc-bd98-f39fe9032e58',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.190498] env[70287]: INFO networking_nsxv3.common.synchronization [None req-37871ed8-0683-4c04-9174-68aa7ad2f54e None None] Enqueued Resource ID: 422725a0-a0c1-4e1a-9124-362eb36dfad6 with Priority: HIGHEST for action port [ 1067.191068] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 422725a0-a0c1-4e1a-9124-362eb36dfad6 with Priority: HIGHEST for action port [ 1067.191393] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-422725a0-a0c1-4e1a-9124-362eb36dfad6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.191646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-422725a0-a0c1-4e1a-9124-362eb36dfad6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.191646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-422725a0-a0c1-4e1a-9124-362eb36dfad6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.191831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-422725a0-a0c1-4e1a-9124-362eb36dfad6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.191911] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('422725a0-a0c1-4e1a-9124-362eb36dfad6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.565287] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.568060] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.568060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.568060] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7802a07-0720-49dc-bd98-f39fe9032e58 with status ACTIVE [ 1067.568259] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.568259] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.568330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.569027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.569027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.569027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.569027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.569027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.570231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.570231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.570231] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.570231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.570231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.570231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.570231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.570231] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7802a07-0720-49dc-bd98-f39fe9032e58 is going to be updated. [ 1067.588617] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.588769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.588837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.589038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.589171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.589346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7802a07-0720-49dc-bd98-f39fe9032e58" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.693989] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 422725a0-a0c1-4e1a-9124-362eb36dfad6 [ 1067.695018] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.695018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.695018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.695018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.695018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.695018] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:422725a0-a0c1-4e1a-9124-362eb36dfad6 already deleted. [ 1067.695018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-422725a0-a0c1-4e1a-9124-362eb36dfad6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.068100] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.385272] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 in Status: SUCCESS [ 1068.385454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.385629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.385953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.386221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.386360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.386428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.386591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.386687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.386802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.386910] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.573408] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.573408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.573776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.573776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.573776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.573878] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be created. [ 1068.595662] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.595785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.595856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.596054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.596195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.604157] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: UNINITIALIZED for 2s [ 1068.889424] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.392625] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 190b5a64-9816-4072-acb7-4bc2c9f8f4b9: rpc.has_security_group_logging(os_id): False [ 1069.411024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.411024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.411024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.411024] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 is going to be created. [ 1069.468468] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.468468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.468468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.468468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.468468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.477995] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 in Status: IN_PROGRESS for 2s [ 1069.802492] env[70287]: INFO networking_nsxv3.common.synchronization [req-19ff5519-d44c-4181-96a1-93f07106735f req-ef15d7d0-758d-4310-bb88-011350e0e251 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1069.802985] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1069.803780] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.803780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.803780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.803780] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.803780] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.804084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.804084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.804084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.804180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.804262] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.129851] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.130020] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.130134] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.130400] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.130671] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.130808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.130970] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.131634] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.131634] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.131634] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.131634] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1070.131805] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1070.131843] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1070.131932] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1070.132051] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1070.132188] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1070.153718] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1070.153965] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1070.154158] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1070.154383] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.154787] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.155035] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.155214] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.155770] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.155887] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d288376e-84fc-4cec-8da9-f3b8f7ad43ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.306275] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.306454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.306494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.306708] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.306853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.307064] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.307179] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.307238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.307405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.307493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.307573] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1070.331655] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.331826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.331868] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.332080] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.332223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.345100] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1070.613129] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 1070.613354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.614025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.614025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.614025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.614025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.614232] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.614494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.614494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.614494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.614494] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.659149] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.659149] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.659149] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.659343] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.659343] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.659497] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port d288376e-84fc-4cec-8da9-f3b8f7ad43ae not found, creating... [ 1070.659768] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.659965] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.660164] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.660409] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.660596] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.660848] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.661024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.661144] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.661466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.661519] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.661650] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: d288376e-84fc-4cec-8da9-f3b8f7ad43ae is going to be created. [ 1070.678953] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.679122] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.679256] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.679532] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.679767] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.680076] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.117532] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.117532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.117532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.117532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.117996] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.117996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.117996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.117996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.118171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.118171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.118291] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.118386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.118445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.118584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.118719] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.118810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.118870] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.119018] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.119093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.119170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.119257] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.412739] env[70287]: INFO networking_nsxv3.common.synchronization [req-19ff5519-d44c-4181-96a1-93f07106735f req-8e56b4d2-16c5-46c8-bf3b-3cf1fb9c25ff service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 1071.412956] env[70287]: INFO networking_nsxv3.common.synchronization [req-19ff5519-d44c-4181-96a1-93f07106735f req-8e56b4d2-16c5-46c8-bf3b-3cf1fb9c25ff service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1071.415585] env[70287]: INFO networking_nsxv3.common.synchronization [req-19ff5519-d44c-4181-96a1-93f07106735f req-8e56b4d2-16c5-46c8-bf3b-3cf1fb9c25ff service nova] Enqueued Resource ID: d288376e-84fc-4cec-8da9-f3b8f7ad43ae with Priority: HIGHEST for action port [ 1071.415585] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 1071.415585] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1071.415585] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d288376e-84fc-4cec-8da9-f3b8f7ad43ae with Priority: HIGHEST for action port [ 1071.415585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.415585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.415585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.415585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.415585] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.415585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.416461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.417628] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.419070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.419070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.419070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.419070] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d288376e-84fc-4cec-8da9-f3b8f7ad43ae',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.489892] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 in Status: SUCCESS [ 1071.489892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.621223] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e5e0f30-956b-4713-b190-79d66c86985e: rpc.has_security_group_logging(os_id): False [ 1071.639461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.639618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.639719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.639924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.640025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.640255] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.640356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.640420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.640575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.640653] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.640827] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.640920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.640980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.641135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.641208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.641439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.641489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.641538] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.641674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.641745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.641847] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be created. [ 1071.700078] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.700078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.700078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.700078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.700078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.714464] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 1071.919863] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.919863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.921435] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d288376e-84fc-4cec-8da9-f3b8f7ad43ae with status ACTIVE [ 1071.921435] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.923647] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.923647] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.923647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.923647] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d288376e-84fc-4cec-8da9-f3b8f7ad43ae is going to be updated. [ 1071.944607] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.944851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.944851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.945039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.945174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.945332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d288376e-84fc-4cec-8da9-f3b8f7ad43ae" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.355248] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1072.355515] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f deletion is rescheduled due to dependency. [ 1072.355572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.355741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.355971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.356173] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.356306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.356373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.356541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.356623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.356746] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.860069] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.363399] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.728769] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 1073.729014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.868749] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.868945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.869034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.869314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.869426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.869544] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1073.895414] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.895556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.895843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.896205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.896503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.906594] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1074.965206] env[70287]: INFO networking_nsxv3.common.synchronization [req-2cf44edc-5710-4e29-977b-337af5163762 req-b023742c-4bb5-46e5-9346-9f94f13d76c0 tempest-ServerMetadataNegativeTestJSON-835933141 tempest-ServerMetadataNegativeTestJSON-835933141-project-member] Enqueued Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_members [ 1074.965206] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_members [ 1074.965206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.965206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.965206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.965967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.966262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.966501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.966669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.966979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.967196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.967491] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.356446] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-829 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.356982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.356982] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.357195] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.357468] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.357633] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.357756] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.357995] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.358159] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.358360] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.358474] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.358590] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.358701] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.358813] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1075.358924] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.359074] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.378816] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.379097] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1075.379317] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.379580] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.380026] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.380290] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.380481] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.380907] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.381156] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4084eca-79ae-45e5-aea8-ddfa6a58d68e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.470014] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.470234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.470314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.470543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.470652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.470872] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.470992] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.471070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.471246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.471343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.471434] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 already deleted. [ 1075.471520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.884265] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.888115] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port c4084eca-79ae-45e5-aea8-ddfa6a58d68e not found, creating... [ 1075.888115] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.888115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.888666] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.889312] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.891764] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.891764] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.891764] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.891764] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: c4084eca-79ae-45e5-aea8-ddfa6a58d68e is going to be created. [ 1075.911143] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.911143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.911143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.911143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.911143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.911143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.917145] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.917145] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.917145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.917145] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.419429] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.672317] env[70287]: INFO networking_nsxv3.common.synchronization [req-2cf44edc-5710-4e29-977b-337af5163762 req-20a82443-f97f-4f4a-b55f-79a573913a28 service nova] Enqueued Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_rules [ 1076.672317] env[70287]: INFO networking_nsxv3.common.synchronization [req-2cf44edc-5710-4e29-977b-337af5163762 req-20a82443-f97f-4f4a-b55f-79a573913a28 service nova] Enqueued Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_members [ 1076.672317] env[70287]: INFO networking_nsxv3.common.synchronization [req-2cf44edc-5710-4e29-977b-337af5163762 req-20a82443-f97f-4f4a-b55f-79a573913a28 service nova] Enqueued Resource ID: c4084eca-79ae-45e5-aea8-ddfa6a58d68e with Priority: HIGHEST for action port [ 1076.672317] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_rules [ 1076.672317] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_members [ 1076.672317] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4084eca-79ae-45e5-aea8-ddfa6a58d68e with Priority: HIGHEST for action port [ 1076.672664] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.672664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.672664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.672788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.672861] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.673695] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.673830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.673895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.674066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.674244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.674330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.674401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.674896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.674896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.674896] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.678195] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.678195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.678195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.678195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.678195] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4084eca-79ae-45e5-aea8-ddfa6a58d68e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.922175] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f: rpc.has_security_group_logging(os_id): False [ 1076.939944] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.940122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.940197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.940556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.940556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.940811] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.940900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.940975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.941176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.941276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.941368] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1076.951034] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4067d6d-d5ec-4296-af8e-0ecb58a64fd8 req-4b787de2-2a63-494f-a36e-d763d1b2d07c tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1076.951508] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1076.952257] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.952257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.952257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.952257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.952467] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.952467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.952559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.952634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.952716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.952824] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.999067] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.999162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.999229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.999451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.999601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.010940] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1077.179171] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.180392] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.180518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.180934] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4084eca-79ae-45e5-aea8-ddfa6a58d68e with status ACTIVE [ 1077.181190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.181313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.181383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.181728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.181728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.181833] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.181961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.182020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.183397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.183397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.183397] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.183397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.183397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.183397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.183397] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.183397] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4084eca-79ae-45e5-aea8-ddfa6a58d68e is going to be updated. [ 1077.206508] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.206629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.206681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.206848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.207021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.207187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4084eca-79ae-45e5-aea8-ddfa6a58d68e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.250706] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.250706] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.250706] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.250706] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.250961] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.251170] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.251322] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.251572] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.251751] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.251967] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.252157] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.252305] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.252424] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.252631] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1077.252701] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.252851] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.271289] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.271499] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1077.271696] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.271901] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.272259] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-b4bea601-0632-411c-94c1-80bada977e67 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.272476] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.272627] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.272964] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.273188] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4bea601-0632-411c-94c1-80bada977e67',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.455719] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.456088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.456088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.456253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.456399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.456604] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.456709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.456773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.456994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.457086] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.457175] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1077.481203] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.481384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.481427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.481621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.481755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.489821] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1077.681706] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.778150] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.778150] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port b4bea601-0632-411c-94c1-80bada977e67 not found, creating... [ 1077.778150] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.778150] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.778512] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.778512] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.778512] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.778512] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.779129] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.779447] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: b4bea601-0632-411c-94c1-80bada977e67 is going to be created. [ 1077.798062] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.798521] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.798780] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.800452] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.800452] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.800452] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.184910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.185101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.185177] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.185395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.185487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.185591] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 is going to be created. [ 1078.210387] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.210545] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.210603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.210814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.210973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.222329] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 in Status: UNINITIALIZED for 2s [ 1078.623546] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4067d6d-d5ec-4296-af8e-0ecb58a64fd8 req-127f54f3-7f9e-4fb5-b568-0cf3cf2a946f service nova] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 1078.623835] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4067d6d-d5ec-4296-af8e-0ecb58a64fd8 req-127f54f3-7f9e-4fb5-b568-0cf3cf2a946f service nova] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1078.623890] env[70287]: INFO networking_nsxv3.common.synchronization [req-c4067d6d-d5ec-4296-af8e-0ecb58a64fd8 req-127f54f3-7f9e-4fb5-b568-0cf3cf2a946f service nova] Enqueued Resource ID: b4bea601-0632-411c-94c1-80bada977e67 with Priority: HIGHEST for action port [ 1078.624437] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 1078.624630] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1078.624688] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4bea601-0632-411c-94c1-80bada977e67 with Priority: HIGHEST for action port [ 1078.625040] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.625170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.625237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.625450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.625529] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.626783] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.626915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.627134] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4bea601-0632-411c-94c1-80bada977e67 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.627240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.627305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.627483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.627559] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4bea601-0632-411c-94c1-80bada977e67',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.023941] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1079.024201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.129062] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.129211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.130574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4bea601-0632-411c-94c1-80bada977e67 with status ACTIVE [ 1079.130758] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.130867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.131060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.131176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.131261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.131438] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.131534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.131589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.131746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.131819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.132140] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.132262] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.132317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.132445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.132519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.132604] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4bea601-0632-411c-94c1-80bada977e67 is going to be updated. [ 1079.156204] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.156204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.156204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.156204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.156204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.156204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4bea601-0632-411c-94c1-80bada977e67" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.499984] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1079.500185] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a deletion is rescheduled due to dependency. [ 1079.500302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.500459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.500676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.500902] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.501051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.501115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.501272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.501352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.501441] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.004989] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.205292] env[70287]: INFO networking_nsxv3.common.synchronization [req-fbc5881a-56f7-4eb3-9abc-f8381d14026c req-be04314e-47c1-40bc-aabf-61aea8c87a6d tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_members [ 1080.205812] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f041a33f-3065-4123-b535-0695dd2dbb6f with Priority: HIGHEST for action security_group_members [ 1080.207698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-f041a33f-3065-4123-b535-0695dd2dbb6f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.207850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.207908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.208107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.208516] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.208516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.208516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.208682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.208682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.208751] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f041a33f-3065-4123-b535-0695dd2dbb6f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.231717] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 in Status: SUCCESS [ 1080.231915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.232130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.232280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.232469] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.232585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.232649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.232802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.232881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.232965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.233068] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.509041] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.684324] env[70287]: INFO networking_nsxv3.common.synchronization [req-4e7aae52-1b56-4948-ba88-ad09e09fdfd4 req-600d4304-ae91-4cbe-9687-3e3c6afaa34d tempest-ListServerFiltersTestJSON-741390594 tempest-ListServerFiltersTestJSON-741390594-project-member] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 1080.685316] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGHEST for action security_group_members [ 1080.687532] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.687716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.687939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.688561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.688803] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.688960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.689272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.689575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.689735] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.689883] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.710882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.711151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.711315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.711494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.734745] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.736938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.736938] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.736938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.738359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.738359] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.738359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.738359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.738359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.738359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.738359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.738359] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.808729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.808994] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.809261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.809406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.809584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.809676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.809750] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f041a33f-3065-4123-b535-0695dd2dbb6f is going to be updated. [ 1080.834199] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.834448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.834562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.835083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.835349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.843177] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f041a33f-3065-4123-b535-0695dd2dbb6f in Status: IN_PROGRESS for 2s [ 1081.015067] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.015067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.015067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.015481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.016055] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.016055] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1081.047061] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.047208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.047288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.047583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.047984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.057894] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1081.193545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.193728] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.193944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.194042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.194117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.194317] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.194415] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.194480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.194626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.194701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.194783] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be updated. [ 1081.235896] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.235896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.235896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.235896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.235896] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.241201] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba5bbcb7-2707-4cc4-9fe9-50838165cb90: rpc.has_security_group_logging(os_id): False [ 1081.244398] env[70287]: INFO networking_nsxv3.common.synchronization [req-9997a5e5-0691-4014-a6dd-f97e81c8144c req-9eb2c951-9cac-4405-9d6e-c6220727cf4e tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1081.244836] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: IN_PROGRESS for 2s [ 1081.245751] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1081.247143] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.247143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.247143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.247143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.247143] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.247143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.247143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.247143] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.247420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.247420] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.259324] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.259476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.259581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.260046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.260046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.260151] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.260275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.260341] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.260515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.260626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.260830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.260963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.261048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.261200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.261305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.261503] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.261643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.261709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.261851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.261961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.262080] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 is going to be created. [ 1081.318954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.319135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.319176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.319425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.319603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.332407] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 in Status: IN_PROGRESS for 2s [ 1081.749539] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.749697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.749769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.749981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.750136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.750286] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.750374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.750435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.750583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.750657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.750745] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1081.778186] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.778447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.778447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.778666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.778796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.786894] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1081.918539] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-252 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.918700] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.918834] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.919155] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.919461] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.919627] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.919766] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.919987] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.920153] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.920364] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.920480] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1081.920592] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1081.920704] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1081.920815] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1081.920925] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1081.921191] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1081.939609] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1081.939788] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1081.939935] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1081.940148] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-252" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.940477] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.940644] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.940771] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.941121] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.941266] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cba2d99-d5d7-477f-83b1-ea46d09d41f3',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.448379] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.448760] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.448760] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.449057] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.449214] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.449442] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 2cba2d99-d5d7-477f-83b1-ea46d09d41f3 not found, creating... [ 1082.449721] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.449921] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.450108] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.450507] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.450655] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.450958] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.451128] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.451245] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.451462] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.451644] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.451745] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 2cba2d99-d5d7-477f-83b1-ea46d09d41f3 is going to be created. [ 1082.470242] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.470466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.470726] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.471103] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.471345] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.471572] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.852577] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f041a33f-3065-4123-b535-0695dd2dbb6f in Status: SUCCESS [ 1082.852782] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f041a33f-3065-4123-b535-0695dd2dbb6f deletion is rescheduled due to dependency. [ 1082.852901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f041a33f-3065-4123-b535-0695dd2dbb6f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.067144] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1083.067408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.067583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.067798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.068023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.068211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.068278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.068447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.068609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.068609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.068695] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.223233] env[70287]: INFO networking_nsxv3.common.synchronization [req-9997a5e5-0691-4014-a6dd-f97e81c8144c req-d202c6db-1910-4009-b475-4c71b828ddc9 service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 1083.223411] env[70287]: INFO networking_nsxv3.common.synchronization [req-9997a5e5-0691-4014-a6dd-f97e81c8144c req-d202c6db-1910-4009-b475-4c71b828ddc9 service nova] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1083.223556] env[70287]: INFO networking_nsxv3.common.synchronization [req-9997a5e5-0691-4014-a6dd-f97e81c8144c req-d202c6db-1910-4009-b475-4c71b828ddc9 service nova] Enqueued Resource ID: 2cba2d99-d5d7-477f-83b1-ea46d09d41f3 with Priority: HIGHEST for action port [ 1083.224434] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_rules [ 1083.224434] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1083.224434] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cba2d99-d5d7-477f-83b1-ea46d09d41f3 with Priority: HIGHEST for action port [ 1083.225390] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.225390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.225390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.225390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.225390] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.226090] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.226175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.226355] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.226448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.226518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.226673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.226742] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cba2d99-d5d7-477f-83b1-ea46d09d41f3',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.254330] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 in Status: SUCCESS [ 1083.254534] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 deletion is rescheduled due to dependency. [ 1083.254594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.343226] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 in Status: SUCCESS [ 1083.343495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.571371] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.729969] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.729969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.729969] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cba2d99-d5d7-477f-83b1-ea46d09d41f3 with status ACTIVE [ 1083.729969] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.729969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.730191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.730313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.730361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.730510] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.730587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.730645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.730782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.730852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.731050] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.731158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.731205] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.731467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.731558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.731849] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cba2d99-d5d7-477f-83b1-ea46d09d41f3 is going to be updated. [ 1083.752030] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.752030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.752030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.752448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.752715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.753123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cba2d99-d5d7-477f-83b1-ea46d09d41f3" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.795305] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1083.796048] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 1083.796048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.796048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.796199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.796345] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.796496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.796548] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.796706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.796790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.796891] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.074059] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02bff0b8-b4e7-47de-bf5e-9f794b64958a: rpc.has_security_group_logging(os_id): False [ 1084.096431] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.096583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.096633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.096833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.096923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.097247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.097367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.097447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.097625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.097738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.097831] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1084.154079] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.154347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.154537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.154813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.155028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.166114] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1084.299827] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.801664] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.303681] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.303838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.303895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.304148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.304245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.304347] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1085.333649] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.333649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.333649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.333649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.333649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.340184] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1086.179242] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1086.179636] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.174184] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-3c2c37a6-5c7b-4549-834e-3e9a36daaeb0 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1087.174926] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1087.175359] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.175946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.176076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.177083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.178126] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.178126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.178126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.179045] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.179522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.179522] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.285563] env[70287]: INFO networking_nsxv3.common.synchronization [req-865760bf-291c-4e6f-8865-e1a1a0082ecf req-46a4d606-bda6-4cd7-9f82-6806998915a5 tempest-ServersTestJSON-357391558 tempest-ServersTestJSON-357391558-project-member] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1087.286292] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGHEST for action security_group_members [ 1087.286651] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.286811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.286901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.287486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.287486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.287486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.287674] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.288413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.288413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.288413] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.353023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.353023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.353023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.353023] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.617652] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-4cb9dceb-a0e5-4506-8188-f671661114a5 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1087.618251] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1087.618552] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.618655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.682873] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.683085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.683192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.683349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.683438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.683641] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.683751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.683805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.683955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.684162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.684162] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c already deleted. [ 1087.684291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.684783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.684960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.685193] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.685293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.685360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.685503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.685579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.685670] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.795770] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.795770] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.795770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.795770] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be updated. [ 1087.824109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.824109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.824109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.824109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.824109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.832466] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: IN_PROGRESS for 2s [ 1087.855330] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.855330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.855330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.855330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.855611] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.855611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.855721] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.855766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.855856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.855942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.856103] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.856560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.856652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.856810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.856954] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.857356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.857356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.857356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.857565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.857565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.857565] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.066290] env[70287]: INFO networking_nsxv3.common.synchronization [req-fa404f4a-0c3c-48f1-a4ee-6d8bf9fab521 req-16432546-2b81-4d04-8878-c6e8e5338ad9 tempest-ServerMetadataNegativeTestJSON-835933141 tempest-ServerMetadataNegativeTestJSON-835933141-project-member] Enqueued Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_members [ 1088.066850] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGHEST for action security_group_members [ 1088.067207] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.067340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.067385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.068535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.068744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.068930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.068930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.069107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.069197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.069293] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.141542] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-9d40b421-ccfe-4af3-9f51-682e5dfb63a4 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1088.141780] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1088.142103] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.142223] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.188872] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.189218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.189218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.190048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.190207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.190418] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.190533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.190596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.190750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.190826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.190914] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c already deleted. [ 1088.190991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.191170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.191319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.191458] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.191551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.191610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.191745] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.191818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.191908] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.364039] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84f1f591-bba8-479c-a2de-cf9524dceb77: rpc.has_security_group_logging(os_id): False [ 1088.384618] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.384806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.384932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.385235] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.385335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.385593] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.385706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.385771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.385940] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.386043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.386263] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.386376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.386438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.386609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.386751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.386894] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.386988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.387107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.387281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.387395] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.387488] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1088.414630] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.414837] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.414995] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.415413] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.415762] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.415896] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.417173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.417173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.417173] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.417173] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.417173] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1088.417173] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1088.417475] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1088.417475] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1088.417537] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1088.417670] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1088.437539] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1088.437674] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1088.437820] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1088.438014] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.438350] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-1e214bdc-9c26-4332-9bca-debc6c469411 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.438540] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.438648] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.439010] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.439160] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e214bdc-9c26-4332-9bca-debc6c469411',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.450781] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.450912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.450985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.451186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.451781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.479555] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1088.571946] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.572186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.572274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.572504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.572598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.572804] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.572901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.572963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.573148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.573240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.573330] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 is going to be updated. [ 1088.598984] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.599169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.599169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.599360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.599484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.607201] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 in Status: IN_PROGRESS for 2s [ 1088.695718] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.695913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.695913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.696111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.696209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.696419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.696509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.696573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.696725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.696801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.696887] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c already deleted. [ 1088.696963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.941755] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.941964] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.942116] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.942402] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.942556] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.942718] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 1e214bdc-9c26-4332-9bca-debc6c469411 not found, creating... [ 1088.942983] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.943160] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.943505] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.943505] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.943631] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.943949] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.944119] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.944229] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.944437] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.944605] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.944758] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 1e214bdc-9c26-4332-9bca-debc6c469411 is going to be created. [ 1088.966422] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.966608] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.966735] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.966980] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.967295] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.967515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.667554] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-577354d9-e112-4f9d-a886-f1a9820cd70b service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1089.667799] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-577354d9-e112-4f9d-a886-f1a9820cd70b service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1089.667967] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-577354d9-e112-4f9d-a886-f1a9820cd70b service nova] Enqueued Resource ID: 1e214bdc-9c26-4332-9bca-debc6c469411 with Priority: HIGHEST for action port [ 1089.668539] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1089.668671] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1089.668841] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1e214bdc-9c26-4332-9bca-debc6c469411 with Priority: HIGHEST for action port [ 1089.669180] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.669326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.669396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.669651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.669734] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.671494] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.671494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.671494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.671494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.671494] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.671494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.671494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.671722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.671722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.671807] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.672550] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1e214bdc-9c26-4332-9bca-debc6c469411 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.672672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.672812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.672911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.673006] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1e214bdc-9c26-4332-9bca-debc6c469411',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.842651] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 in Status: SUCCESS [ 1089.842920] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 deletion is rescheduled due to dependency. [ 1089.842920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.175082] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.175248] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.175410] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.176307] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1e214bdc-9c26-4332-9bca-debc6c469411 with status ACTIVE [ 1090.176490] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.176607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.176686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.176908] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.177076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.177287] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.177503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.177503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.177659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.177744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.177955] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.178075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.178137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.178294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.178369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.178451] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1e214bdc-9c26-4332-9bca-debc6c469411 is going to be updated. [ 1090.204517] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.204668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.204747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.204941] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.205125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.205280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1e214bdc-9c26-4332-9bca-debc6c469411" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.494774] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1090.495233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.598061] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-101 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.598061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-101" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.598061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-101" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.598061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-101" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.598061] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.598061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.598061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.598061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.598589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.598926] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.599216] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.601389] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.601389] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.601389] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.601389] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.601389] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.620021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.620021] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.620021] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.620021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-101" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.620021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-d2bf985a-6b66-4c13-a27f-c8eb5c061347 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.620021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.620021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.620021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.620021] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2bf985a-6b66-4c13-a27f-c8eb5c061347',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.621181] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 in Status: SUCCESS [ 1090.621504] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 deletion is rescheduled due to dependency. [ 1090.621737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.681101] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.699437] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-709 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.699725] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.699925] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.700251] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.700549] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.700743] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.700890] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.701578] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.701578] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.701578] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.701706] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1090.701706] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1090.701821] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1090.701977] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1090.702116] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1090.702257] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1090.720168] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1090.720406] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1090.720590] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1090.720811] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-709" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.721208] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-751fd7f6-891d-415d-b8c8-ae97fa413536 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.721430] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.721598] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.721897] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.722096] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('751fd7f6-891d-415d-b8c8-ae97fa413536',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.124278] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.124612] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.124781] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.125146] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.125361] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.125552] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port d2bf985a-6b66-4c13-a27f-c8eb5c061347 not found, creating... [ 1091.126118] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.126350] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.126479] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.126764] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.126943] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.127496] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.127853] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.128064] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.128479] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.128666] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.128844] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: d2bf985a-6b66-4c13-a27f-c8eb5c061347 is going to be created. [ 1091.152537] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.152851] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.153074] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.153426] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.153742] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.154055] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.183419] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.183595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.183734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.183967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.184106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.184241] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be created. [ 1091.210554] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.210688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.210750] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.210961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.211133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.224465] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.224676] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.224801] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.225084] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.225229] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.225505] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.225662] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.225778] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.225991] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.226143] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.226430] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.226577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.226695] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.226899] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.227095] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.227250] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 is going to be updated. [ 1091.228858] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: UNINITIALIZED for 2s [ 1091.261255] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.261468] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.261587] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.261863] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.262081] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.262312] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.046081] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-c4e71bd8-1bd7-4105-9040-2548ae058e52 service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1092.046389] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-c4e71bd8-1bd7-4105-9040-2548ae058e52 service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1092.046462] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-c4e71bd8-1bd7-4105-9040-2548ae058e52 service nova] Enqueued Resource ID: d2bf985a-6b66-4c13-a27f-c8eb5c061347 with Priority: HIGHEST for action port [ 1092.046669] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1092.046789] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1092.046931] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2bf985a-6b66-4c13-a27f-c8eb5c061347 with Priority: HIGHEST for action port [ 1092.047488] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.047603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.047777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.047916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.048274] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2bf985a-6b66-4c13-a27f-c8eb5c061347 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.048417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.048481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.048692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.048773] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2bf985a-6b66-4c13-a27f-c8eb5c061347',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.199482] env[70287]: INFO networking_nsxv3.common.synchronization [req-f3dc3d4d-682f-42b2-99af-d5269e77cf45 req-93cd3347-f495-4202-98d2-22a2e4b2fb54 service nova] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_rules [ 1092.199482] env[70287]: INFO networking_nsxv3.common.synchronization [req-f3dc3d4d-682f-42b2-99af-d5269e77cf45 req-93cd3347-f495-4202-98d2-22a2e4b2fb54 service nova] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 1092.199554] env[70287]: INFO networking_nsxv3.common.synchronization [req-f3dc3d4d-682f-42b2-99af-d5269e77cf45 req-93cd3347-f495-4202-98d2-22a2e4b2fb54 service nova] Enqueued Resource ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 with Priority: HIGHEST for action port [ 1092.200093] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_rules [ 1092.200163] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 1092.200584] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 with Priority: HIGHEST for action port [ 1092.200897] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.201026] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.201094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.201286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.201357] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.202144] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.202275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.202335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.202475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.203096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.203096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.203096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.203096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.203096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.203096] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.203722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-751fd7f6-891d-415d-b8c8-ae97fa413536 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.203825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.203892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.204819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.204819] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('751fd7f6-891d-415d-b8c8-ae97fa413536',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.552968] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d2bf985a-6b66-4c13-a27f-c8eb5c061347 with status ACTIVE [ 1092.552968] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.552968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.552968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.553207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.553272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.553458] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.553562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.553622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.553768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.553846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.554033] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.554131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.554182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.554315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.554390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.554474] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d2bf985a-6b66-4c13-a27f-c8eb5c061347 is going to be updated. [ 1092.574602] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.574760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.574809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.574969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.575131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.575289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2bf985a-6b66-4c13-a27f-c8eb5c061347" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.708565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.708565] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.708565] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 751fd7f6-891d-415d-b8c8-ae97fa413536 with status ACTIVE [ 1092.708565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.708565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.708565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.709119] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.709119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.709119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.709119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.709119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.709119] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 751fd7f6-891d-415d-b8c8-ae97fa413536 is going to be updated. [ 1092.739312] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.739466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.739528] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.739731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.739862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.740019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-751fd7f6-891d-415d-b8c8-ae97fa413536" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.979152] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-218 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.979355] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.979487] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.979780] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.980055] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.980227] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.980433] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.980763] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.981011] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.981334] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.981575] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1092.981740] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1092.981921] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1092.982126] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1092.982331] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1092.982514] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1093.005395] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1093.005756] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1093.006045] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1093.006332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-218" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.006925] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-d6016a0e-87f3-42b0-a7b7-db1093aa672c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.007809] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.008149] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.008769] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.009087] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6016a0e-87f3-42b0-a7b7-db1093aa672c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.211828] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.239883] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1093.240209] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.240375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.240591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.240782] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.240902] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.240969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.241137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.241219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.241305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.241410] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.242193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.242368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.242523] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.242624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.242686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.242826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.242903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.242988] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.511990] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.512301] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.512436] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.512960] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.512960] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.513123] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port d6016a0e-87f3-42b0-a7b7-db1093aa672c not found, creating... [ 1093.513786] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.513786] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.513956] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.514130] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.514222] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.514484] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.514646] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.514825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.514976] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.515176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.515320] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: d6016a0e-87f3-42b0-a7b7-db1093aa672c is going to be created. [ 1093.534462] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.534585] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.534700] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.534961] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.535477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.535477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.714664] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.714811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.714950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.715214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.715347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.715538] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be updated. [ 1093.744712] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.744853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.746385] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.748241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.748485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.748485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.748670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.748824] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.757339] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 1094.251155] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.528256] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-f5b86449-3583-4e9a-97ef-c7e3e1f8774f service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1094.528256] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-f5b86449-3583-4e9a-97ef-c7e3e1f8774f service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1094.528256] env[70287]: INFO networking_nsxv3.common.synchronization [req-a32cf935-cee8-4624-abee-ba3250a85f23 req-f5b86449-3583-4e9a-97ef-c7e3e1f8774f service nova] Enqueued Resource ID: d6016a0e-87f3-42b0-a7b7-db1093aa672c with Priority: HIGHEST for action port [ 1094.528256] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1094.528256] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1094.528256] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6016a0e-87f3-42b0-a7b7-db1093aa672c with Priority: HIGHEST for action port [ 1094.528256] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.528256] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.529485] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.529596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.529792] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6016a0e-87f3-42b0-a7b7-db1093aa672c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.529892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.529969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.530194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.530348] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6016a0e-87f3-42b0-a7b7-db1093aa672c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.753584] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.753784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.753878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.754195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.754333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.754481] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1094.783350] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.783513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.783552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.783754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.783893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.791864] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1094.976256] env[70287]: INFO networking_nsxv3.common.synchronization [req-f8413378-7efc-456d-87e7-617afbffd1b9 req-cfa3326a-5912-4e18-a769-80342832359c tempest-ServerDiskConfigTestJSON-967991729 tempest-ServerDiskConfigTestJSON-967991729-project-member] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1094.976776] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGHEST for action security_group_members [ 1094.978095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.978095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.978095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.978095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.978095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.978095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.978095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.978095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.978095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.978447] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.032145] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6016a0e-87f3-42b0-a7b7-db1093aa672c with status ACTIVE [ 1095.032374] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.032504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.032571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.032772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.032859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.033046] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.033146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.033208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.033355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.033429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.033606] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.033697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.033756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.033891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.033962] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.034067] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6016a0e-87f3-42b0-a7b7-db1093aa672c is going to be updated. [ 1095.053752] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.053875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.053937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.054145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.054493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.054493] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6016a0e-87f3-42b0-a7b7-db1093aa672c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.480345] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.480631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.480631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.480787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.480879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.481466] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.481466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.481466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.481466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.481466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.481705] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be updated. [ 1095.508462] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.508633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.508679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.508867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.509009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.517659] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: IN_PROGRESS for 2s [ 1095.767614] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 1095.767842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.767999] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.768233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.768426] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.768543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.768609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.768783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.768843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.768929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.769027] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.091364] env[70287]: INFO networking_nsxv3.common.synchronization [None req-58b01809-20ec-4961-9161-fecd278c2228 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_rules [ 1096.091891] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_rules [ 1096.092216] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb04e66f-c59f-46c7-add9-c2a370e670cd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.092385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.092434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.092736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.093114] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.194442] env[70287]: INFO networking_nsxv3.common.synchronization [None req-f97ddf90-5d8e-487f-bdfb-f37ddf772fba tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_rules [ 1096.194442] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_rules [ 1096.195096] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb04e66f-c59f-46c7-add9-c2a370e670cd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.195271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.271686] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.271948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.271948] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.272124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.272291] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.272420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.272495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.272577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.272658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.272738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.272878] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.272969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.273040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.273160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.273287] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.273370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.273432] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.273549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.273616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.273687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.273769] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.616859] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.616859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.616859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.617318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.617318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.617318] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb04e66f-c59f-46c7-add9-c2a370e670cd already deleted. [ 1096.617679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.617791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.617904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.617991] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.775643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe: rpc.has_security_group_logging(os_id): False [ 1096.796777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.796777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.796777] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.796953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.800968] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1096.801138] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.801333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.802150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.802150] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.802150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.802150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.802150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.802150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.802430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.802430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.802501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.802557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.802700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.802843] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.802961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.803106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.803268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.803352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.803967] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.804095] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.805846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.806031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.806189] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.806331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.806404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.806560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.806852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.806963] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.819170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.819476] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.819583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.819654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.819851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.820137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.820285] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.820393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.820440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.820639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.820712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.820915] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.821017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.821181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.821249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.821354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.821405] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be updated. [ 1096.880718] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.880893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.880990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.881243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.881683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.896980] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 1097.140143] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.140313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.140366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.140577] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.140648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.140738] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb04e66f-c59f-46c7-add9-c2a370e670cd already deleted. [ 1097.140849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.306405] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d238a734-e9e8-4cc0-9269-25cb9f7f981c: rpc.has_security_group_logging(os_id): False [ 1097.309292] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.324112] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.324253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.324318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.324526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.324616] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.324809] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.324965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.324965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.325145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.325242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.325434] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.325527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.325588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.325727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.325803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.325992] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.326098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.326160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.326301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.326374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.326458] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be created. [ 1097.383578] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.383781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.383832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.384054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.384238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.394346] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1097.528540] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 in Status: SUCCESS [ 1097.528727] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 deletion is rescheduled due to dependency. [ 1097.528889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.812397] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.315595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.315778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.315816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.316605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.316605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.316605] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1098.344204] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.344475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.344546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.344727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.344976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.353486] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1098.910293] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 1098.910664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.406473] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1099.406878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.407127] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.407247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.407366] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.616865] env[70287]: INFO networking_nsxv3.common.synchronization [None req-dbe4c8ba-55e5-4a23-aac5-65e8d94c31a1 None None] Enqueued Resource ID: 453d6d01-c0b3-4425-932c-2b2016667619 with Priority: HIGHEST for action port [ 1099.617609] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 453d6d01-c0b3-4425-932c-2b2016667619 with Priority: HIGHEST for action port [ 1099.618835] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-453d6d01-c0b3-4425-932c-2b2016667619 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.619061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-453d6d01-c0b3-4425-932c-2b2016667619" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.619176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-453d6d01-c0b3-4425-932c-2b2016667619" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.619519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-453d6d01-c0b3-4425-932c-2b2016667619" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.619881] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('453d6d01-c0b3-4425-932c-2b2016667619',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.911074] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.911414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.122227] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 453d6d01-c0b3-4425-932c-2b2016667619 [ 1100.122461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.122461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.122629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.122690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.122810] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.122871] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:453d6d01-c0b3-4425-932c-2b2016667619 already deleted. [ 1100.122973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-453d6d01-c0b3-4425-932c-2b2016667619" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.366147] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.366147] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.366147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.366147] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.871356] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.871525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.871595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.871821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.871985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.872090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.872151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.872293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.872374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.872459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.872603] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.872689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.872747] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.872888] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.873028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.873115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.873180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.873703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.873703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.873703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.873703] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.376097] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d238a734-e9e8-4cc0-9269-25cb9f7f981c: rpc.has_security_group_logging(os_id): False [ 1101.393814] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.395100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.395100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.395100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.395100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.395100] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.395100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.396060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.396060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.396060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.396060] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.396060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.396060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.396060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.396265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.396317] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.396411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.396465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.396631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.396681] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.396799] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1101.461275] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.461275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.461275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.461275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.461275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.472442] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1102.359706] env[70287]: INFO networking_nsxv3.common.synchronization [None req-859a6d6c-e927-4335-bede-b71b010f39df None None] Enqueued Resource ID: 12357046-ada6-45bb-99a5-6cea76890cc0 with Priority: HIGHEST for action port [ 1102.359995] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12357046-ada6-45bb-99a5-6cea76890cc0 with Priority: HIGHEST for action port [ 1102.360670] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-12357046-ada6-45bb-99a5-6cea76890cc0 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.360791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12357046-ada6-45bb-99a5-6cea76890cc0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.360865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12357046-ada6-45bb-99a5-6cea76890cc0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.361380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12357046-ada6-45bb-99a5-6cea76890cc0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.361463] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12357046-ada6-45bb-99a5-6cea76890cc0',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.865341] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12357046-ada6-45bb-99a5-6cea76890cc0 [ 1102.865630] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.865785] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.865890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.866149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.866250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.866351] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12357046-ada6-45bb-99a5-6cea76890cc0 already deleted. [ 1102.866436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12357046-ada6-45bb-99a5-6cea76890cc0" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.486747] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1103.486963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.487168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.487473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.487563] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.990753] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.991067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.991067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.991210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.991383] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.991490] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.991556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.991859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.991859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.991859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.991955] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.495692] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.495853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.495920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.496163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.496331] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.496431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.496486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.496633] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.496713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.496796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.496934] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.497152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.497152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.497247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.497395] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.497484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.497543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.497680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.497826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.497826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.498080] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.886670] env[70287]: INFO networking_nsxv3.common.synchronization [req-8d7b2d19-20df-4107-adaf-d6c7f5d19fe1 req-16643cfc-bf30-4729-84d8-17da9bba65c0 tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_members [ 1104.887279] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_members [ 1104.887601] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb04e66f-c59f-46c7-add9-c2a370e670cd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.888146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.888146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.888146] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.888310] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.888796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.888796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.888796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.888796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.889165] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.003375] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d238a734-e9e8-4cc0-9269-25cb9f7f981c: rpc.has_security_group_logging(os_id): False [ 1105.020648] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.020799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.020881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.021133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.021228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.021440] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.021550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.021614] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.021779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.021856] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.022073] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.022198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.022266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.022430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.022799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.022799] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.022897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.022897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.023043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.023119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.023216] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1105.079171] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.079394] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.079439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.079659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.079807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.095739] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1105.391399] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.391575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.391647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.391889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.391975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.392198] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.392318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.392403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.392585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.392670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.392760] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb04e66f-c59f-46c7-add9-c2a370e670cd already deleted. [ 1105.392837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.509592] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-875 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.509592] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.509592] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.509592] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.510136] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.510542] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.511219] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.511615] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.512016] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.512518] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.512853] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.513138] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.513388] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.513696] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1105.513962] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.514272] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.543825] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.543825] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1105.543965] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.544170] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.544508] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.544694] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.544824] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.545245] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.545423] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.047935] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.048328] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.048389] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.048743] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.049024] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.049024] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 not found, creating... [ 1106.049766] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.049766] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.049766] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.049939] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.049999] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.050453] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.050562] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.050684] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.050905] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.051095] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.051227] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 is going to be created. [ 1106.072502] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.072790] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.072924] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.073193] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.073436] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.073657] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.821242] env[70287]: INFO networking_nsxv3.common.synchronization [req-8d7b2d19-20df-4107-adaf-d6c7f5d19fe1 req-a145a2d0-ea58-4347-84d0-e1c40b097e31 service nova] Enqueued Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_rules [ 1106.821422] env[70287]: INFO networking_nsxv3.common.synchronization [req-8d7b2d19-20df-4107-adaf-d6c7f5d19fe1 req-a145a2d0-ea58-4347-84d0-e1c40b097e31 service nova] Enqueued Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_members [ 1106.821569] env[70287]: INFO networking_nsxv3.common.synchronization [req-8d7b2d19-20df-4107-adaf-d6c7f5d19fe1 req-a145a2d0-ea58-4347-84d0-e1c40b097e31 service nova] Enqueued Resource ID: 8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 with Priority: HIGHEST for action port [ 1106.821808] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_rules [ 1106.821950] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_members [ 1106.822069] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 with Priority: HIGHEST for action port [ 1106.822604] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb04e66f-c59f-46c7-add9-c2a370e670cd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.822734] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.822802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.823013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.823229] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.824920] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb04e66f-c59f-46c7-add9-c2a370e670cd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.825056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.825126] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.825333] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.825495] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.825639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.825639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.825790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.825873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.825962] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.830518] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.830640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.830709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.830882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.830962] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.108016] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a82a608-83bb-44d6-9682-5cda9bfd2c35 req-349cc980-5f1f-4e07-aab8-227a5934fded tempest-ServerRescueTestJSON-1965886216 tempest-ServerRescueTestJSON-1965886216-project-member] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1107.108752] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1107.108863] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.108969] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.109108] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.109347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.110044] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.110044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.110044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.110044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.110044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.110269] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.111468] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1107.111662] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.325398] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb04e66f-c59f-46c7-add9-c2a370e670cd taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.325911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.330963] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.336119] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 with status ACTIVE [ 1107.336364] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.337655] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.337655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.337655] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.338171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.338171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.338171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.338171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.338171] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8 is going to be updated. [ 1107.356103] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.356276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.356324] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.356506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.356634] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.356807] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a8ff3d5-beb0-45dc-8716-e0cb03fb6fd8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.504859] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.505090] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.505825] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.507364] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.507692] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.507873] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.507993] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.508251] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.508416] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.509047] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.509210] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.509333] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.509455] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.509578] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1107.509689] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.510071] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.528279] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.528428] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1107.528589] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.528821] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.529254] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-871deaab-c18f-4a5c-94ef-815ece9a9649 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.529357] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.529465] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.529803] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.529943] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('871deaab-c18f-4a5c-94ef-815ece9a9649',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.613626] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.613798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.613872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.614118] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.614266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.614410] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.614512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.614574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.614723] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.614816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.614946] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 already deleted. [ 1107.615056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.834886] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.035600] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.035940] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.036165] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.036518] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.036735] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.036956] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 871deaab-c18f-4a5c-94ef-815ece9a9649 not found, creating... [ 1108.037366] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.037636] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.044253] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.044656] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.044896] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.045328] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.045574] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.045760] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.046574] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.046574] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.046574] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 871deaab-c18f-4a5c-94ef-815ece9a9649 is going to be created. [ 1108.065465] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.065694] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.065822] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.066115] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.066351] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.066581] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.337232] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.337562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.337562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.337765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.337901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.338061] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb04e66f-c59f-46c7-add9-c2a370e670cd is going to be created. [ 1108.368392] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.368585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.368675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.368929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.369145] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.377859] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb04e66f-c59f-46c7-add9-c2a370e670cd in Status: UNINITIALIZED for 2s [ 1108.931527] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a82a608-83bb-44d6-9682-5cda9bfd2c35 req-c4731cd6-9270-443b-8b25-4d45ce63532e service nova] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_rules [ 1108.931527] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a82a608-83bb-44d6-9682-5cda9bfd2c35 req-c4731cd6-9270-443b-8b25-4d45ce63532e service nova] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1108.931527] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a82a608-83bb-44d6-9682-5cda9bfd2c35 req-c4731cd6-9270-443b-8b25-4d45ce63532e service nova] Enqueued Resource ID: 871deaab-c18f-4a5c-94ef-815ece9a9649 with Priority: HIGHEST for action port [ 1108.931527] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_rules [ 1108.931527] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1108.931527] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 871deaab-c18f-4a5c-94ef-815ece9a9649 with Priority: HIGHEST for action port [ 1108.931527] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.931527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.931527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.931527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.931527] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.932067] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.932067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.932067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.932193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.932294] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.932464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.932464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.932535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.932796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.932796] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.933656] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-871deaab-c18f-4a5c-94ef-815ece9a9649 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.933796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.933838] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.933963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.934249] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('871deaab-c18f-4a5c-94ef-815ece9a9649',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.273966] env[70287]: INFO networking_nsxv3.common.synchronization [req-79cb307e-7023-4895-94a3-ea37f2b3c8a6 req-e965746e-956c-46b1-8cda-ca5f54d16795 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1109.274803] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1109.275346] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.275568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.275660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.275945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.276223] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.276390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.276495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.276727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.276863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.277016] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.436073] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.436464] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.438014] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.438973] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 871deaab-c18f-4a5c-94ef-815ece9a9649 with status ACTIVE [ 1109.439195] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.439520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.439520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.439631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.439673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.439838] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.439932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.439993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.440161] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.440233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.440421] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.440516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.440594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.440739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.440812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.440897] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 871deaab-c18f-4a5c-94ef-815ece9a9649 is going to be updated. [ 1109.461158] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.461322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.461374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.461702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.461875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.462088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-871deaab-c18f-4a5c-94ef-815ece9a9649" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.609281] env[70287]: INFO networking_nsxv3.common.synchronization [req-79cb307e-7023-4895-94a3-ea37f2b3c8a6 req-286418e4-3cb3-4edd-ba60-32becd59a7a2 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1109.609869] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1109.610216] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.610319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.779757] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.847757] env[70287]: INFO networking_nsxv3.common.synchronization [req-79cb307e-7023-4895-94a3-ea37f2b3c8a6 req-d724a524-36af-47b6-8c37-793a951f60c0 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1109.848326] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1109.848899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.848899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.943865] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.282236] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.387594] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb04e66f-c59f-46c7-add9-c2a370e670cd in Status: SUCCESS [ 1110.387854] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.388037] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.388291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.388536] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.388675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.388757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.388903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.388993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.389087] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.389181] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.446948] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.447426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.447426] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.447553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.447672] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.447755] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 is going to be created. [ 1110.470506] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.470725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.470725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.471033] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.471298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.481576] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: UNINITIALIZED for 2s [ 1110.784920] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.785117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.785213] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.785539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.785648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.785755] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1110.817760] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.817974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.818054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.818352] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.818495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.827418] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1110.891773] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.393740] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb04e66f-c59f-46c7-add9-c2a370e670cd: rpc.has_security_group_logging(os_id): False [ 1111.413290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.413484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.413484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.414206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.414206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.414206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.414396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.414396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.414468] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.414564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.414644] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb04e66f-c59f-46c7-add9-c2a370e670cd is going to be created. [ 1111.482250] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.482626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.482626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.482705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.482900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.492111] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb04e66f-c59f-46c7-add9-c2a370e670cd in Status: IN_PROGRESS for 2s [ 1112.491928] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: SUCCESS [ 1112.492288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.492330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.492587] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.492794] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.492917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.492997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.493195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.493283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.493387] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.493486] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.837545] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1112.837843] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.838078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.838452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.838702] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.838839] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.838907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.839175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.839175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.839285] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.996218] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.996218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.996338] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.996572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.996812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.996950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.997054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.997281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.997483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.997554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.997710] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.997864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.997922] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.998151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.998338] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.998981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.999083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.999313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.999487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.999620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.999744] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.341582] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.341809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.341809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.342072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.342184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.342382] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.342551] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.342609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.342829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.342937] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.343094] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1113.368998] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.369173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.369244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.369482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.369625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.377262] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1113.502334] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 440e3530-396b-4e0b-b2b9-e88ce8edefb7: rpc.has_security_group_logging(os_id): False [ 1113.503970] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb04e66f-c59f-46c7-add9-c2a370e670cd in Status: SUCCESS [ 1113.504198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.519839] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.519979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.520063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.520287] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.520381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.520720] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.520720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.520822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.520916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.520996] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.521190] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.521300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.521366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.521480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.521549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.521727] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.521822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.521882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.522030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.522107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.522192] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 is going to be created. [ 1113.576477] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.576617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.576659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.576857] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.577052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.588537] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: IN_PROGRESS for 2s [ 1114.849114] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1114.849405] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1115.387327] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1115.387617] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c deletion is rescheduled due to dependency. [ 1115.387782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.388133] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.388253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.388456] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.388626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.388679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.388852] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.389383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.389383] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.600614] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: SUCCESS [ 1115.600917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.891835] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.891835] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.892298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.892298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.892298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.892482] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.892598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.892669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.892882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.892974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.893089] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1115.917743] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.917929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.917971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.918181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.918316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.926510] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1117.937435] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1117.937783] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c deletion is rescheduled due to dependency. [ 1117.937783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.850860] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1119.851148] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1120.632257] env[70287]: INFO networking_nsxv3.common.synchronization [req-6469fde7-cb4d-4a9b-ab08-e9ae5ced0c28 req-adf92c7c-6b8d-44b7-942f-38d4e83c4374 tempest-DeleteServersTestJSON-811743662 tempest-DeleteServersTestJSON-811743662-project-member] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1120.632535] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGHEST for action security_group_members [ 1120.632864] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.632988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.633072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.633275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.633427] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.633521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.633583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.633718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.633801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.633893] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.143691] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.143993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.143993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.144176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.144273] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.144473] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.144572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.144635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.144788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.144862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.144949] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be updated. [ 1121.184194] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.184442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.184550] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.184812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.184977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.195031] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: IN_PROGRESS for 2s [ 1121.866383] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-8b989768-7ca8-4088-9eb7-54ac810a5013 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1121.866934] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1121.867268] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.867386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.867495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.867706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.867855] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.867950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.868083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.868272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.868381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.868514] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.152698] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-b7744ad7-604c-436e-95f0-8c65d040840b tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1122.152698] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1122.152698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.152698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.373302] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.373302] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.373302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.373302] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1122.403717] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.403717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.403717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.403717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.403717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.433990] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1122.484466] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-364 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.484466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-364" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.484466] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-364" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.484638] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-364" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.484938] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.485170] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.485332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.485580] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.485814] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.486095] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.486232] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.486354] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.486467] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.486605] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1122.486730] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.486928] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.511330] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.511593] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1122.511734] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.511949] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-364" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.512341] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.512554] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.512703] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.513081] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.513282] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.015344] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.015710] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.015888] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.016284] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.016681] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.016915] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 not found, creating... [ 1123.017255] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.017485] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.017636] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.018088] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.018320] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.018676] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.018893] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.019073] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.019382] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.019651] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.019813] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 is going to be created. [ 1123.038550] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.038834] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.038974] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.039282] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.039758] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.040048] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.211195] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e5e0f30-956b-4713-b190-79d66c86985e in Status: SUCCESS [ 1123.211195] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e deletion is rescheduled due to dependency. [ 1123.211195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.820038] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-939f32d6-7945-4ab1-8e7d-96524d57dd93 service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1123.820228] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-939f32d6-7945-4ab1-8e7d-96524d57dd93 service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1123.820369] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-939f32d6-7945-4ab1-8e7d-96524d57dd93 service nova] Enqueued Resource ID: b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 with Priority: HIGHEST for action port [ 1123.820608] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1123.820729] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1123.820819] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 with Priority: HIGHEST for action port [ 1123.821388] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.821506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.821592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.823876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.823986] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.824831] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.824925] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.825132] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.825228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.825288] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.825465] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.825543] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.327401] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.327776] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.327855] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 with status ACTIVE [ 1124.328093] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.328557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.328557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.328557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.328709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.328847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.328963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.329039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.329237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.329309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.329458] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.329655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.329655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.329773] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.329806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.329925] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6 is going to be updated. [ 1124.348577] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.348779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.348861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.349078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.349537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.349537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0cf0905-3ad3-4bf7-9fe1-d2b9fd998ac6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.443638] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1124.443839] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c deletion is rescheduled due to dependency. [ 1124.443954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.444132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.444379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.444565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.444830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.444830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.444972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.444972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.445075] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.660772] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-972 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.660772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-972" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.660772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-972" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.660772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-972" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.660772] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.660772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.660772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.660772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.660772] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.661352] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.661352] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.661352] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.661352] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.661352] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1124.661535] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.661617] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.680404] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.680552] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1124.680709] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.680870] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-972" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.681185] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.681356] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.681477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.681883] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.681962] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc69c2ae-1561-4ff3-ba1c-479f71d870fc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.947392] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.184899] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.184899] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.185349] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.185815] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.185815] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.185815] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port dc69c2ae-1561-4ff3-ba1c-479f71d870fc not found, creating... [ 1125.186161] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.186313] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.186387] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.186694] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.186853] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.187196] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.187545] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.187545] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.187796] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.187946] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.188113] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: dc69c2ae-1561-4ff3-ba1c-479f71d870fc is going to be created. [ 1125.210815] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.211055] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.211814] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.211814] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.211814] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.212009] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.450876] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.952283] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.952449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.952556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.952798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.952893] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.952997] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1125.982386] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.982573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.982624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.983194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.983194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.991827] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1126.053276] env[70287]: INFO networking_nsxv3.common.synchronization [req-946d1203-a70d-41bb-b8dc-d2982bf5d94a req-741bc870-1c75-404f-b43b-0dc10edc1a03 tempest-ServersNegativeTestJSON-782058407 tempest-ServersNegativeTestJSON-782058407-project-member] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 1126.053845] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGHEST for action security_group_members [ 1126.054181] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.054311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.054376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.054591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.054757] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.054859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.054928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.055738] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.055848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.055939] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.128707] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-ac76d704-2b0f-49b7-b6fb-2883502f3d56 service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1126.128865] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-ac76d704-2b0f-49b7-b6fb-2883502f3d56 service nova] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1126.129110] env[70287]: INFO networking_nsxv3.common.synchronization [req-dcac0638-d69c-4ce5-8400-dab6c0895724 req-ac76d704-2b0f-49b7-b6fb-2883502f3d56 service nova] Enqueued Resource ID: dc69c2ae-1561-4ff3-ba1c-479f71d870fc with Priority: HIGHEST for action port [ 1126.130149] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_rules [ 1126.130375] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1126.130528] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc69c2ae-1561-4ff3-ba1c-479f71d870fc with Priority: HIGHEST for action port [ 1126.130991] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.131176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.131521] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.131680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.131968] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.132135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.132222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.132512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.132674] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc69c2ae-1561-4ff3-ba1c-479f71d870fc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.558038] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.558364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.558364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.558559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.558559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.558787] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.558881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.558950] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.559110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.559186] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.559274] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be updated. [ 1126.585534] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.585704] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.585775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.585913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.586059] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.595990] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: IN_PROGRESS for 2s [ 1126.635436] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc69c2ae-1561-4ff3-ba1c-479f71d870fc with status ACTIVE [ 1126.635436] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.635610] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.635649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.636864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.636864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.636864] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.636864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.636864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.636864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.636864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.637187] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.637187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.637187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.637187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.637308] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.637337] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc69c2ae-1561-4ff3-ba1c-479f71d870fc is going to be updated. [ 1126.660636] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.660813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.660899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.661154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.661335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.661529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc69c2ae-1561-4ff3-ba1c-479f71d870fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.008438] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1128.008748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.009884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.009884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.009884] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.009884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.009884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.009884] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.010206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.010206] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.515936] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.608765] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe in Status: SUCCESS [ 1128.608765] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe deletion is rescheduled due to dependency. [ 1128.608765] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.017959] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.520644] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.521032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.521174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.521505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.521679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.521843] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1129.549239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.549403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.549443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.549648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.549793] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.558416] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1131.132038] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1131.132038] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1131.569260] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1131.569482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.569648] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.569875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.570138] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.570238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.570238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.570386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.570463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.570557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.570701] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.572264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.572264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.572264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.572264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.572264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.572264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.572264] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.572264] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.074339] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.074567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.075863] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.578718] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.082014] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.082302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.082412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.082680] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.084172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.084298] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1133.110744] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.111419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.111419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.111419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.111568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.119680] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1134.401981] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.401981] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.401981] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.401981] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.402496] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.402670] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.403130] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.403305] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.403488] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.404148] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.404319] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1134.404467] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1134.404610] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1134.404753] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1134.404887] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1134.405069] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1134.425440] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1134.425651] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1134.425816] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1134.425994] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-529" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.426332] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-1d5ef292-01cb-426a-a5e6-0e5bef41c756 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.426504] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.426628] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.426906] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.427062] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d5ef292-01cb-426a-a5e6-0e5bef41c756',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.932019] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.932019] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.932019] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.932707] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.932707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.932707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.932707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.932707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.932707] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 is going to be updated. [ 1134.953515] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.953515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.953515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.953515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.953515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.953515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.132022] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.132022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.132022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.132022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.132022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.132952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.133216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.133454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.133671] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.636699] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d238a734-e9e8-4cc0-9269-25cb9f7f981c: rpc.has_security_group_logging(os_id): False [ 1135.653862] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.654175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.654175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.654258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.654337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.654558] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.654675] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.654739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.654891] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.655076] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.655408] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.655408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.655408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.655605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.655605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.655809] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.655923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.655982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.656290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.656371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.656458] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1135.727090] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.727260] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.727321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.727574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.727744] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.748760] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1136.025208] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7a4c4a16-c561-40b0-bb87-317dbc5c75d5 None None] Enqueued Resource ID: 23a1321f-d2ab-4e80-8092-34752940963f with Priority: HIGHEST for action port [ 1136.025467] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23a1321f-d2ab-4e80-8092-34752940963f with Priority: HIGHEST for action port [ 1136.026052] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-23a1321f-d2ab-4e80-8092-34752940963f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.026173] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23a1321f-d2ab-4e80-8092-34752940963f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.026243] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23a1321f-d2ab-4e80-8092-34752940963f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.029063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23a1321f-d2ab-4e80-8092-34752940963f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.029063] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23a1321f-d2ab-4e80-8092-34752940963f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.146131] env[70287]: INFO networking_nsxv3.common.synchronization [req-879d0307-ac29-4247-9738-65c880fa09bc req-3f0cc50b-168e-4fcf-a5f2-58156bda8ac3 service nova] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1136.146287] env[70287]: INFO networking_nsxv3.common.synchronization [req-879d0307-ac29-4247-9738-65c880fa09bc req-3f0cc50b-168e-4fcf-a5f2-58156bda8ac3 service nova] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1136.146436] env[70287]: INFO networking_nsxv3.common.synchronization [req-879d0307-ac29-4247-9738-65c880fa09bc req-3f0cc50b-168e-4fcf-a5f2-58156bda8ac3 service nova] Enqueued Resource ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 with Priority: HIGHEST for action port [ 1136.146948] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_rules [ 1136.147097] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1136.147196] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 with Priority: HIGHEST for action port [ 1136.147461] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.147579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.147682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.147866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.147947] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.149024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.149240] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.149290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.149510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.149704] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.149846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.149945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.150157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.150292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.150673] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.151217] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-1d5ef292-01cb-426a-a5e6-0e5bef41c756 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.151379] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.151495] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.151689] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.151804] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1d5ef292-01cb-426a-a5e6-0e5bef41c756',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.524045] env[70287]: INFO networking_nsxv3.common.synchronization [req-4427f276-653f-4bb3-a5f0-f11b1ea28a57 req-74c34249-da82-4139-8efc-2797ace52c48 tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1136.524893] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1136.524893] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.525013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.525047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.525298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.529757] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.529757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.529757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.529757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.529757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.529757] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.532182] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23a1321f-d2ab-4e80-8092-34752940963f [ 1136.532182] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.532182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.532182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.532182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.532182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.532182] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23a1321f-d2ab-4e80-8092-34752940963f already deleted. [ 1136.532182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23a1321f-d2ab-4e80-8092-34752940963f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.656017] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.656017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.656017] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1d5ef292-01cb-426a-a5e6-0e5bef41c756 with status ACTIVE [ 1136.656017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.656017] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.656017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.656720] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.656720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.656720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.656720] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.656898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.657093] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1d5ef292-01cb-426a-a5e6-0e5bef41c756 is going to be updated. [ 1136.688984] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.688984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.688984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.688984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.688984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.688984] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1d5ef292-01cb-426a-a5e6-0e5bef41c756" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.028386] env[70287]: INFO networking_nsxv3.common.synchronization [req-4427f276-653f-4bb3-a5f0-f11b1ea28a57 req-d6d1859d-c229-4a9e-9c78-2d4c26a5e7ea tempest-ServersTestMultiNic-517604501 tempest-ServersTestMultiNic-517604501-project-member] Enqueued Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1137.028935] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c with Priority: HIGHEST for action security_group_members [ 1137.029243] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d238a734-e9e8-4cc0-9269-25cb9f7f981c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.029339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.032595] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.159762] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.535868] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.662160] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.662459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.663387] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.663736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.663801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.663888] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 is going to be updated. [ 1137.694068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.694068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.694068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.694068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.694068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.700722] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: IN_PROGRESS for 2s [ 1137.764213] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1137.765671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.765903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.767478] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.767478] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.908628] env[70287]: INFO networking_nsxv3.common.synchronization [None req-5ac8ef6f-6492-47a4-a4c1-27199a22cf6f None None] Enqueued Resource ID: 7ac217c7-2f77-40c8-a88a-41de907f2bfa with Priority: HIGHEST for action port [ 1137.908896] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ac217c7-2f77-40c8-a88a-41de907f2bfa with Priority: HIGHEST for action port [ 1137.909801] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ac217c7-2f77-40c8-a88a-41de907f2bfa taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.909801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ac217c7-2f77-40c8-a88a-41de907f2bfa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.909801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ac217c7-2f77-40c8-a88a-41de907f2bfa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.909801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ac217c7-2f77-40c8-a88a-41de907f2bfa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.909957] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ac217c7-2f77-40c8-a88a-41de907f2bfa',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.037801] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.038236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.038334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.038535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.038624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.038746] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be updated. [ 1138.065683] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.065829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.065906] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.066131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.066407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.075111] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: IN_PROGRESS for 2s [ 1138.290694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.290694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.290694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.291082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.291250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.291409] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be deleted. [ 1138.341645] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.341798] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.341872] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.342199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.342199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.342349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.414426] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ac217c7-2f77-40c8-a88a-41de907f2bfa [ 1138.414683] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.414797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.414864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.415122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.415196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.415283] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ac217c7-2f77-40c8-a88a-41de907f2bfa already deleted. [ 1138.415359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ac217c7-2f77-40c8-a88a-41de907f2bfa" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.710927] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: SUCCESS [ 1139.710927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.710927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.711290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.711290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.711290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.711412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.711536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.711619] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.711705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.711795] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.085069] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c in Status: SUCCESS [ 1140.085178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.085334] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.085558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.085743] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.085860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.085926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.086091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.086171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.086268] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d238a734-e9e8-4cc0-9269-25cb9f7f981c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.214410] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.588433] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.588602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.588730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.588946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.589056] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.589259] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.589355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.589412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.589554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.589627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.589812] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d238a734-e9e8-4cc0-9269-25cb9f7f981c is going to be deleted. [ 1140.618676] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.618676] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.618899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.619015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.619092] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.619211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d238a734-e9e8-4cc0-9269-25cb9f7f981c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.716974] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d139a12c-73ef-4c1b-a08c-ef24b2ea3b83: rpc.has_security_group_logging(os_id): False [ 1140.734422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.734576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.734656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.734960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.735100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.735355] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.735491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.735561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.735748] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.735882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.735951] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 is going to be updated. [ 1140.794457] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.795299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.795299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.795299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.795488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.807262] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: IN_PROGRESS for 2s [ 1141.377465] env[70287]: INFO networking_nsxv3.common.synchronization [req-e20279a3-2936-4a49-847f-e926fd855ea8 req-3bfbcd7c-4484-4a84-9091-429c389b806c tempest-ServerRescueTestJSON-1965886216 tempest-ServerRescueTestJSON-1965886216-project-member] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1141.378216] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1141.378572] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.378736] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.378813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.379032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.379193] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.379295] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.379357] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.379506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.379590] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.379684] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.836974] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-761 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.841358] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.841556] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.841795] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.842108] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.842281] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.842401] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.842637] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.842783] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.842996] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.843122] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.843231] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.843339] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.843450] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1141.843557] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.843689] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.865999] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.866074] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1141.866211] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.866406] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-761" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.866695] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.866870] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.866989] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.867332] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.867476] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.881649] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.371919] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.372116] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.372270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.372593] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.372783] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.373173] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd not found, creating... [ 1142.373304] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.373507] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.373672] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.373946] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.374139] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.374668] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.374668] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.374811] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.375058] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.375218] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.375367] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd is going to be created. [ 1142.383131] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.395683] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.395932] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.396118] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.396411] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.396638] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.396885] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.821864] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: SUCCESS [ 1142.822139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.885475] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.886428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.886428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.886428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.886582] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.886582] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 is going to be updated. [ 1142.915157] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.915299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.915368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.915572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.915713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.923970] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: IN_PROGRESS for 2s [ 1143.125152] env[70287]: INFO networking_nsxv3.common.synchronization [req-e20279a3-2936-4a49-847f-e926fd855ea8 req-57435953-b382-4cc4-b85b-ba34fd2c95a1 service nova] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_rules [ 1143.125344] env[70287]: INFO networking_nsxv3.common.synchronization [req-e20279a3-2936-4a49-847f-e926fd855ea8 req-57435953-b382-4cc4-b85b-ba34fd2c95a1 service nova] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1143.125488] env[70287]: INFO networking_nsxv3.common.synchronization [req-e20279a3-2936-4a49-847f-e926fd855ea8 req-57435953-b382-4cc4-b85b-ba34fd2c95a1 service nova] Enqueued Resource ID: bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd with Priority: HIGHEST for action port [ 1143.125719] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_rules [ 1143.125842] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1143.125937] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd with Priority: HIGHEST for action port [ 1143.126477] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.126600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.126667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.126864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.126946] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.128609] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.128710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.129368] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.129483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.129552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.133020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.133020] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.632020] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.632182] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.632368] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd with status ACTIVE [ 1143.632539] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.632647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.632711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.632930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.633036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.633218] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.633316] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.633372] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.633521] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.633601] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.633781] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.633874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.633933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.634094] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.634168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.634250] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd is going to be updated. [ 1143.656466] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.656668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.656668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.656881] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.657022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.657184] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd7d4ed5-6adb-4e2b-8560-dee1116ab8bd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.934478] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: SUCCESS [ 1144.934770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.934934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.935309] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.936104] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.936104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.936104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.936104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.936339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.936339] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.439584] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.941519] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.444027] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.444027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.444027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.444027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.444286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.444286] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 is going to be updated. [ 1146.472585] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.472783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.472878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.473120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.473298] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.481618] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: IN_PROGRESS for 2s [ 1148.127437] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1148.127743] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1148.492669] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: SUCCESS [ 1148.492912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.493106] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.493327] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.493525] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.493710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.493779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.493934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.494028] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.494117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.494581] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.996263] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.996441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.996513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.996743] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.996914] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.997058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.997098] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.997252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.997339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.997427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.997576] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.997670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.997731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.997939] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.998089] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.998181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.998365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.998365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.998434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.998518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.998606] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.502466] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 440e3530-396b-4e0b-b2b9-e88ce8edefb7: rpc.has_security_group_logging(os_id): False [ 1149.521116] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.521269] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.521386] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.521596] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.521683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.521899] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.522424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.522424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.522424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.522424] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.522690] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.522690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.522690] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.522847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.522847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.522955] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.523265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.523360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.523514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.523591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.523679] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 is going to be updated. [ 1149.585444] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.585444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.585639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.586233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.586233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.610691] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: IN_PROGRESS for 2s [ 1149.951533] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7dca3522-f4c9-4809-ac36-57e3925fedaa None None] Enqueued Resource ID: 01397b23-4e19-4c3c-8fa9-3db6de058361 with Priority: HIGHEST for action port [ 1149.951804] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01397b23-4e19-4c3c-8fa9-3db6de058361 with Priority: HIGHEST for action port [ 1149.952380] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-01397b23-4e19-4c3c-8fa9-3db6de058361 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.952502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01397b23-4e19-4c3c-8fa9-3db6de058361" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.953164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01397b23-4e19-4c3c-8fa9-3db6de058361" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.953164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01397b23-4e19-4c3c-8fa9-3db6de058361" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.953164] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01397b23-4e19-4c3c-8fa9-3db6de058361',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.455064] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01397b23-4e19-4c3c-8fa9-3db6de058361 [ 1150.455064] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.455244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.455244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.455408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.455501] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.455597] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01397b23-4e19-4c3c-8fa9-3db6de058361 already deleted. [ 1150.455695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01397b23-4e19-4c3c-8fa9-3db6de058361" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.147323] env[70287]: INFO networking_nsxv3.common.synchronization [None req-96f40f0d-0d59-4344-9ddd-c670e0a5e64f tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_rules [ 1151.147733] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_rules [ 1151.147994] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15c84255-e5bf-4821-86ca-a3b374c86875 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.148141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.148210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.148471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.148779] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.331016] env[70287]: INFO networking_nsxv3.common.synchronization [None req-4c960d99-db1b-4ff1-9e30-b93f73ee41a0 tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_rules [ 1151.331016] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_rules [ 1151.331016] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15c84255-e5bf-4821-86ca-a3b374c86875 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.331016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.624858] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: SUCCESS [ 1151.625151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.671007] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.671200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.671275] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.671460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.671549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.671643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15c84255-e5bf-4821-86ca-a3b374c86875 already deleted. [ 1151.671730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.671886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.672070] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.672152] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.944219] env[70287]: INFO networking_nsxv3.common.synchronization [None req-28c49a0f-c668-487b-9714-ae99176bda99 None None] Enqueued Resource ID: 09c05722-2bbe-4a97-bdd1-374d23595e9e with Priority: HIGHEST for action port [ 1151.944219] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09c05722-2bbe-4a97-bdd1-374d23595e9e with Priority: HIGHEST for action port [ 1151.944219] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-09c05722-2bbe-4a97-bdd1-374d23595e9e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.944219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-09c05722-2bbe-4a97-bdd1-374d23595e9e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.944219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-09c05722-2bbe-4a97-bdd1-374d23595e9e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.944219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-09c05722-2bbe-4a97-bdd1-374d23595e9e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.944219] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('09c05722-2bbe-4a97-bdd1-374d23595e9e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.191035] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.191346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.191346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.191484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.191594] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.191687] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15c84255-e5bf-4821-86ca-a3b374c86875 already deleted. [ 1152.191766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.447239] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 09c05722-2bbe-4a97-bdd1-374d23595e9e [ 1152.447384] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.447491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.447562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.447770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.447913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.448034] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:09c05722-2bbe-4a97-bdd1-374d23595e9e already deleted. [ 1152.448111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-09c05722-2bbe-4a97-bdd1-374d23595e9e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.386811] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a40cea0-1629-40e5-a711-6ec1f8b4d748 req-6d20a0ea-ab0f-4ead-8c80-f15acbf34ad8 tempest-InstanceActionsNegativeTestJSON-319885841 tempest-InstanceActionsNegativeTestJSON-319885841-project-member] Enqueued Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_members [ 1153.387566] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_members [ 1153.388015] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.388211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.388320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.388637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.388860] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.389044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.389117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.389305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.389390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.389492] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.708496] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-345 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.708808] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-345" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.709029] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-345" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.709515] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-345" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.709941] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.710224] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.710426] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.710766] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.711022] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.711367] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.711580] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1153.711764] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1153.711950] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1153.712166] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1153.712343] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1153.712562] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1153.731752] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1153.732019] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1153.732246] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1153.732528] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-345" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.733059] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.733291] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.733502] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.733971] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.734233] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd00f0bd-a8e8-4264-9ccf-ace51885ffe6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.893202] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.893202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.893202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.893202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.893202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.893202] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.893202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.893202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.893202] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.893651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.893651] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 already deleted. [ 1153.893651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.236857] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.237240] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.237823] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.237823] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.238132] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.238438] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 not found, creating... [ 1154.238913] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.239680] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.239838] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.240229] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.240511] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.240898] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.241123] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.241281] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.241566] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.241725] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.241879] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 is going to be created. [ 1154.262827] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.262827] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.262827] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.263060] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.263333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.263570] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.951442] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a40cea0-1629-40e5-a711-6ec1f8b4d748 req-ce4f0241-4b39-4493-8dc4-d901671ab065 service nova] Enqueued Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_rules [ 1154.951722] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a40cea0-1629-40e5-a711-6ec1f8b4d748 req-ce4f0241-4b39-4493-8dc4-d901671ab065 service nova] Enqueued Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_members [ 1154.952866] env[70287]: INFO networking_nsxv3.common.synchronization [req-3a40cea0-1629-40e5-a711-6ec1f8b4d748 req-ce4f0241-4b39-4493-8dc4-d901671ab065 service nova] Enqueued Resource ID: cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 with Priority: HIGHEST for action port [ 1154.952866] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_rules [ 1154.952866] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_members [ 1154.952866] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 with Priority: HIGHEST for action port [ 1154.952866] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.953216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.953216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.953284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.953372] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.954222] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.954342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.954405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.954568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.954722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.954811] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.954878] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.955942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.955942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.955942] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.955942] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.956151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.956151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.956404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.956404] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd00f0bd-a8e8-4264-9ccf-ace51885ffe6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.458831] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.459040] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.459303] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.460135] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 with status ACTIVE [ 1155.460427] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.460564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.460652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.460889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.461032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.461225] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.461351] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.461434] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.461620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.461737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.461952] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.462113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.462113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.462261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.462342] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.462410] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd00f0bd-a8e8-4264-9ccf-ace51885ffe6 is going to be updated. [ 1155.481902] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.482119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.482119] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.482306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.482438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.482836] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd00f0bd-a8e8-4264-9ccf-ace51885ffe6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.964627] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.466867] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.467074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.467171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.467402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.467506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.467617] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 is going to be created. [ 1156.491129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.491281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.491281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.491485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.491646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.500614] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 in Status: UNINITIALIZED for 2s [ 1158.513128] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 in Status: SUCCESS [ 1158.513128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.513128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.513128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.513128] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.513128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.513128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.513699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.513699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.513699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.513699] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.520665] env[70287]: INFO networking_nsxv3.common.synchronization [req-8563202b-6f64-4768-b9fb-33a81d5e2e0e req-666f9f52-7ba6-41d7-b238-c77618e39aa8 tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_members [ 1158.520837] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_members [ 1158.522091] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c84255-e5bf-4821-86ca-a3b374c86875 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.522091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.522091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.522091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.522091] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.522091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.522091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.522091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.522091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.522505] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.810926] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.810926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.810926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.810926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.810926] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.810926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.810926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.810926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.810926] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.811826] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.812131] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1158.812393] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1158.812640] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1158.814079] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1158.814079] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1158.814079] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1158.831132] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1158.831321] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1158.831457] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1158.831638] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.831948] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.832163] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.832294] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.832607] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.832800] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8220cd7-88c5-456a-92f6-98a9a80c3ca8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.016303] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.016303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.017129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.017129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.017129] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.017129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.017129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.017129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.017129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.017428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.017428] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.017428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.017524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.017686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.017850] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.018112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.018337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.018454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.018454] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.018546] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.018623] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.026404] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.026512] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.026924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.026924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.026924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.027067] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.027116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.027147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.027998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.027998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.027998] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c84255-e5bf-4821-86ca-a3b374c86875 already deleted. [ 1159.027998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.334666] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.334885] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.335123] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.335494] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.335732] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.335873] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f8220cd7-88c5-456a-92f6-98a9a80c3ca8 not found, creating... [ 1159.336327] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.336613] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.336835] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.337223] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.337477] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.338019] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.338270] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.338526] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.338826] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.338975] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.339142] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f8220cd7-88c5-456a-92f6-98a9a80c3ca8 is going to be created. [ 1159.362725] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.362944] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.363094] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.363525] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.363776] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.364012] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.522324] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d6a1c404-909c-4d2a-8a7d-03a5e01c1417: rpc.has_security_group_logging(os_id): False [ 1159.543852] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.544063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.544063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.544282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.544388] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.544609] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.544709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.544768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.544933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.545019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.545246] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.545346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.545420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.545628] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.545716] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.545993] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.546109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.546109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.546246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.546322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.546441] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 is going to be created. [ 1159.610525] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.610667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.610742] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.610951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.611151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.623785] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 in Status: IN_PROGRESS for 2s [ 1160.153581] env[70287]: INFO networking_nsxv3.common.synchronization [req-8563202b-6f64-4768-b9fb-33a81d5e2e0e req-27434ea3-e103-4fa6-9b90-313a7d14b793 service nova] Enqueued Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_rules [ 1160.153774] env[70287]: INFO networking_nsxv3.common.synchronization [req-8563202b-6f64-4768-b9fb-33a81d5e2e0e req-27434ea3-e103-4fa6-9b90-313a7d14b793 service nova] Enqueued Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_members [ 1160.153918] env[70287]: INFO networking_nsxv3.common.synchronization [req-8563202b-6f64-4768-b9fb-33a81d5e2e0e req-27434ea3-e103-4fa6-9b90-313a7d14b793 service nova] Enqueued Resource ID: f8220cd7-88c5-456a-92f6-98a9a80c3ca8 with Priority: HIGHEST for action port [ 1160.154168] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_rules [ 1160.154295] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_members [ 1160.154467] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8220cd7-88c5-456a-92f6-98a9a80c3ca8 with Priority: HIGHEST for action port [ 1160.154955] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-15c84255-e5bf-4821-86ca-a3b374c86875 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.155363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.155492] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.155669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.155795] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.157179] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c84255-e5bf-4821-86ca-a3b374c86875 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.157330] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.157428] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.157914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.157914] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.157914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.157914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.158236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.158347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.158462] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.159290] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.159624] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.159763] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.160128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.160128] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8220cd7-88c5-456a-92f6-98a9a80c3ca8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.663078] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c84255-e5bf-4821-86ca-a3b374c86875 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.663078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.663078] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.663841] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8220cd7-88c5-456a-92f6-98a9a80c3ca8 with status ACTIVE [ 1160.664053] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.664236] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.664276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.664911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.664911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.664911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.664911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.664911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.665193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.665193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.665326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.665409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.665474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.665630] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.665711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.665794] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8220cd7-88c5-456a-92f6-98a9a80c3ca8 is going to be updated. [ 1160.686929] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.687192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.687284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.687469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.687613] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.687799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8220cd7-88c5-456a-92f6-98a9a80c3ca8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.167717] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.634942] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 in Status: SUCCESS [ 1161.635210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.669902] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.670292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.670292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.670445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.670535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.670643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c84255-e5bf-4821-86ca-a3b374c86875 is going to be created. [ 1161.693375] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.693556] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.693605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.693774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.693930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.706031] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c84255-e5bf-4821-86ca-a3b374c86875 in Status: UNINITIALIZED for 2s [ 1163.717876] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c84255-e5bf-4821-86ca-a3b374c86875 in Status: SUCCESS [ 1163.718329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.718404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.718640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.718835] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.718971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.719075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.719250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.719368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.719436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.719535] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.222277] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.727903] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 15c84255-e5bf-4821-86ca-a3b374c86875: rpc.has_security_group_logging(os_id): False [ 1164.746210] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.746365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.746462] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.746944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.746944] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.747095] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.747170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.747230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.747411] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.747485] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.747578] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 15c84255-e5bf-4821-86ca-a3b374c86875 is going to be created. [ 1164.803012] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.803210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.803268] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.803507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.803699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.822517] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15c84255-e5bf-4821-86ca-a3b374c86875 in Status: IN_PROGRESS for 2s [ 1165.155826] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1165.155931] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1166.837987] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 15c84255-e5bf-4821-86ca-a3b374c86875 in Status: SUCCESS [ 1166.838356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.239602] env[70287]: INFO networking_nsxv3.common.synchronization [req-2f2dafbe-5e3f-4faa-9a19-3da9f8892162 req-b91280df-5982-49c2-b7c3-fac76b008cde tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1167.240215] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1167.240470] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.240592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.240658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.240849] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.241008] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.241138] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.241234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.241445] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.241516] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.241605] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.454778] env[70287]: INFO networking_nsxv3.common.synchronization [req-fd8b5bc5-4bc9-45d4-a88f-10970c8e10af req-2540dea1-5726-4363-98b6-ee977edaba1c tempest-InstanceActionsNegativeTestJSON-319885841 tempest-InstanceActionsNegativeTestJSON-319885841-project-member] Enqueued Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_members [ 1167.455304] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGHEST for action security_group_members [ 1167.455644] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.455814] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.455890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.457930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.458198] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.458350] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.458422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.458600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.458717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.458819] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.743898] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.744140] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.744194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.744440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.744539] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.744750] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.744864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.744930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.745104] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.745192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.745280] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1167.772075] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.772257] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.772303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.772484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.772626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.780469] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1167.961486] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.961782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.961782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.961913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.962014] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.962207] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.962305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.962364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.962515] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.962593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.962676] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 is going to be updated. [ 1167.990381] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.990554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.990629] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.990822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.990961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.999963] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 in Status: IN_PROGRESS for 2s [ 1169.790612] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1169.790924] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a deletion is rescheduled due to dependency. [ 1169.790924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.009271] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 in Status: SUCCESS [ 1170.009503] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 deletion is rescheduled due to dependency. [ 1170.009612] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.172773] env[70287]: INFO networking_nsxv3.common.synchronization [req-dbd4809e-9084-435c-a9b7-87b0af216dd5 req-3b33a463-b868-4cea-9288-71b0784cdecd tempest-ServerRescueTestJSON-1965886216 tempest-ServerRescueTestJSON-1965886216-project-member] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1170.173304] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1170.175025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.175025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.175025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.175025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.175025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.175025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.175025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.175025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.175025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.175025] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.266186] env[70287]: INFO networking_nsxv3.common.synchronization [req-38d31fdc-1c84-42d5-9b6c-e0aa4944ece9 req-dc55821b-b2d4-4418-8401-d063c505fa8d tempest-AttachVolumeNegativeTest-804692502 tempest-AttachVolumeNegativeTest-804692502-project-member] Enqueued Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_members [ 1170.266186] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb04e66f-c59f-46c7-add9-c2a370e670cd with Priority: HIGHEST for action security_group_members [ 1170.266186] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb04e66f-c59f-46c7-add9-c2a370e670cd taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.266409] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.266498] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.266772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.267422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.267422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.267422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.267422] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.267935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.267935] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb04e66f-c59f-46c7-add9-c2a370e670cd',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.676924] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.770286] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.770466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.770585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.770821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.770911] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.771133] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.771246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.771368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.771527] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.771642] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.771757] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb04e66f-c59f-46c7-add9-c2a370e670cd is going to be updated. [ 1170.797543] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.797946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.797946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.798302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.798479] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.806883] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb04e66f-c59f-46c7-add9-c2a370e670cd in Status: IN_PROGRESS for 2s [ 1171.180091] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.683058] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.683274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.683331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.683510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.683605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.683706] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 is going to be updated. [ 1171.708008] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.708222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.708276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.708433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.708571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.716802] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: IN_PROGRESS for 2s [ 1172.818488] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb04e66f-c59f-46c7-add9-c2a370e670cd in Status: SUCCESS [ 1172.818488] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb04e66f-c59f-46c7-add9-c2a370e670cd deletion is rescheduled due to dependency. [ 1172.818488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb04e66f-c59f-46c7-add9-c2a370e670cd" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.726428] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: SUCCESS [ 1173.727274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.110949] env[70287]: INFO networking_nsxv3.common.synchronization [None req-25cb8b48-5753-407c-93de-f51fec78a656 None None] Enqueued Resource ID: 4ef9523f-1952-4a7a-9202-3f73f3ed1208 with Priority: HIGHEST for action port [ 1175.111277] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ef9523f-1952-4a7a-9202-3f73f3ed1208 with Priority: HIGHEST for action port [ 1175.111810] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ef9523f-1952-4a7a-9202-3f73f3ed1208 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.111934] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ef9523f-1952-4a7a-9202-3f73f3ed1208" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.112012] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ef9523f-1952-4a7a-9202-3f73f3ed1208" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.112272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ef9523f-1952-4a7a-9202-3f73f3ed1208" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.112357] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ef9523f-1952-4a7a-9202-3f73f3ed1208',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.616244] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ef9523f-1952-4a7a-9202-3f73f3ed1208 [ 1175.616497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.616667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.616751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.616987] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.617144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.617274] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ef9523f-1952-4a7a-9202-3f73f3ed1208 already deleted. [ 1175.617373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ef9523f-1952-4a7a-9202-3f73f3ed1208" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.663111] env[70287]: INFO networking_nsxv3.common.synchronization [req-439308a3-30c9-4731-9eea-93994ccc2d34 req-98e29ef5-55bc-400d-b8f4-973f4c3098be tempest-ServerRescueTestJSON-1965886216 tempest-ServerRescueTestJSON-1965886216-project-member] Enqueued Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1176.663917] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 with Priority: HIGHEST for action security_group_members [ 1176.666792] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-440e3530-396b-4e0b-b2b9-e88ce8edefb7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.667022] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.667315] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.667650] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.668022] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.668169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.668261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.668450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.668561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.668678] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('440e3530-396b-4e0b-b2b9-e88ce8edefb7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.171598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.171755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.171826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.172061] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.172157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.172346] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.172443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.172506] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.172656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.172731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.172817] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 is going to be updated. [ 1177.210979] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.211303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.211303] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.211491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.211647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.220052] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: IN_PROGRESS for 2s [ 1177.347058] env[70287]: INFO networking_nsxv3.common.synchronization [None req-02d2079e-c91b-4326-8233-39d923313cb6 None None] Enqueued Resource ID: 64605e8c-f17d-47f1-80b8-f9952d1158c7 with Priority: HIGHEST for action port [ 1177.347980] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64605e8c-f17d-47f1-80b8-f9952d1158c7 with Priority: HIGHEST for action port [ 1177.348378] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-64605e8c-f17d-47f1-80b8-f9952d1158c7 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.348504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64605e8c-f17d-47f1-80b8-f9952d1158c7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.348569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64605e8c-f17d-47f1-80b8-f9952d1158c7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.349074] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64605e8c-f17d-47f1-80b8-f9952d1158c7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.349170] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64605e8c-f17d-47f1-80b8-f9952d1158c7',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.447533] env[70287]: INFO networking_nsxv3.common.synchronization [None req-7c3ccc6b-b70d-4d49-b017-849431450c70 None None] Enqueued Resource ID: 168ed647-0a9a-4b59-b18c-60c2cb3f82fc with Priority: HIGHEST for action port [ 1177.447769] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 168ed647-0a9a-4b59-b18c-60c2cb3f82fc with Priority: HIGHEST for action port [ 1177.448307] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-168ed647-0a9a-4b59-b18c-60c2cb3f82fc taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.448430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-168ed647-0a9a-4b59-b18c-60c2cb3f82fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.448499] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-168ed647-0a9a-4b59-b18c-60c2cb3f82fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.448746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-168ed647-0a9a-4b59-b18c-60c2cb3f82fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.448840] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('168ed647-0a9a-4b59-b18c-60c2cb3f82fc',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.851402] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64605e8c-f17d-47f1-80b8-f9952d1158c7 [ 1177.851683] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.851826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.851895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.852124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.852769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.852769] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64605e8c-f17d-47f1-80b8-f9952d1158c7 already deleted. [ 1177.852769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64605e8c-f17d-47f1-80b8-f9952d1158c7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.952517] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 168ed647-0a9a-4b59-b18c-60c2cb3f82fc [ 1177.952796] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.953313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.953313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.953541] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.953753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.953887] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:168ed647-0a9a-4b59-b18c-60c2cb3f82fc already deleted. [ 1177.954011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-168ed647-0a9a-4b59-b18c-60c2cb3f82fc" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.232290] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 in Status: SUCCESS [ 1179.232597] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 440e3530-396b-4e0b-b2b9-e88ce8edefb7 deletion is rescheduled due to dependency. [ 1179.232656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-440e3530-396b-4e0b-b2b9-e88ce8edefb7" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.376896] env[70287]: INFO networking_nsxv3.common.synchronization [req-f720b8a7-6870-45a4-b85f-ea2576a6d8bf req-a0d090fb-4f63-4ace-ba13-78c427346e22 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1179.377533] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1179.378329] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.378329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.378329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.378783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.378969] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.379112] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.379221] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.379436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.379647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.379769] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.517929] env[70287]: INFO networking_nsxv3.common.synchronization [None req-a0deadf3-2b8f-47a2-9378-7e1497384eb3 None None] Enqueued Resource ID: 7f81b876-6977-4338-8fb7-84c9f18c0d5d with Priority: HIGHEST for action port [ 1179.518478] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f81b876-6977-4338-8fb7-84c9f18c0d5d with Priority: HIGHEST for action port [ 1179.519135] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f81b876-6977-4338-8fb7-84c9f18c0d5d taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.519389] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f81b876-6977-4338-8fb7-84c9f18c0d5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.519534] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f81b876-6977-4338-8fb7-84c9f18c0d5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.519883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f81b876-6977-4338-8fb7-84c9f18c0d5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.520042] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f81b876-6977-4338-8fb7-84c9f18c0d5d',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.818821] env[70287]: INFO networking_nsxv3.common.synchronization [req-e93979cf-8fa2-4964-9465-7a9bbb9f0b8d req-a0aff1f0-4766-468a-877d-f960d9e56a9e tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1179.819348] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1179.819667] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.819787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.819853] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.824019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.824019] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.824019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.824019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.824019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.824019] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.824019] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.882917] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.882917] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.883090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.883766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.884502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.884502] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.884502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.884502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.884502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.884502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.885183] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1179.912147] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.912535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.912535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.912535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.912701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.921619] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1180.024186] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f81b876-6977-4338-8fb7-84c9f18c0d5d [ 1180.026389] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.027463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.027463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.027463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.027463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.027463] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f81b876-6977-4338-8fb7-84c9f18c0d5d already deleted. [ 1180.027463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f81b876-6977-4338-8fb7-84c9f18c0d5d" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.306024] env[70287]: INFO networking_nsxv3.common.synchronization [req-364c6d92-0506-4d5c-acf4-cbd8e05a75bf req-ea421502-8a2b-4031-8237-0904759ce795 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_members [ 1180.306024] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGHEST for action security_group_members [ 1180.306024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.306024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.306024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.306024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.306024] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.306024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.306024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.306024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.306024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.306024] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.324077] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.324258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.324444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.324510] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.324584] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.324857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.324964] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.325042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.325203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.325305] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.325390] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1180.349317] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.349524] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.349580] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.349770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.349928] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.358594] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1180.453642] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-811 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.453940] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.454155] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.454585] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.454975] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.455252] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.455458] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.455816] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.456085] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.456398] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.456568] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.456734] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.456898] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.457080] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1180.457258] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.458078] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.477035] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.477125] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1180.479393] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.479393] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-811" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.479393] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-65d314c9-a33b-4ab4-966a-d6418e003907 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.479393] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.479393] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.479393] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.479393] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65d314c9-a33b-4ab4-966a-d6418e003907',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.809221] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.809447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.809494] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.809687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.809783] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.809983] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.810096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.810154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.810299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.810374] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.810462] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 is going to be updated. [ 1180.835542] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.835714] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.835770] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.836185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.836367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.844376] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 in Status: IN_PROGRESS for 2s [ 1180.985021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.985021] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 65d314c9-a33b-4ab4-966a-d6418e003907 not found, creating... [ 1180.985021] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.985021] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.985536] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.985536] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.985536] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.985536] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.985745] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.986592] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 65d314c9-a33b-4ab4-966a-d6418e003907 is going to be created. [ 1181.006491] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.007011] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.007110] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.007421] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.007659] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.008041] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.707587] env[70287]: INFO networking_nsxv3.common.synchronization [req-e93979cf-8fa2-4964-9465-7a9bbb9f0b8d req-071e026c-8c21-4605-a734-4d27ef484b97 service nova] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 1181.707874] env[70287]: INFO networking_nsxv3.common.synchronization [req-e93979cf-8fa2-4964-9465-7a9bbb9f0b8d req-071e026c-8c21-4605-a734-4d27ef484b97 service nova] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1181.707874] env[70287]: INFO networking_nsxv3.common.synchronization [req-e93979cf-8fa2-4964-9465-7a9bbb9f0b8d req-071e026c-8c21-4605-a734-4d27ef484b97 service nova] Enqueued Resource ID: 65d314c9-a33b-4ab4-966a-d6418e003907 with Priority: HIGHEST for action port [ 1181.708039] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_rules [ 1181.708130] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1181.708280] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65d314c9-a33b-4ab4-966a-d6418e003907 with Priority: HIGHEST for action port [ 1181.709051] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.709051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.714801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.715686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.715892] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.720023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.720023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.720023] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-65d314c9-a33b-4ab4-966a-d6418e003907 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.720023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.720023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.720023] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.720023] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65d314c9-a33b-4ab4-966a-d6418e003907',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.932241] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1181.932241] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f deletion is rescheduled due to dependency. [ 1181.932241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.219344] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.219800] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.222456] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65d314c9-a33b-4ab4-966a-d6418e003907 with status ACTIVE [ 1182.222722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.222998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.223113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.223370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.223486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.223695] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.223805] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.223866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.224073] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.224147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.224326] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.224417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.224476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.224658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.224739] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.224995] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65d314c9-a33b-4ab4-966a-d6418e003907 is going to be updated. [ 1182.244074] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.244249] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.244317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.244536] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.244671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.244828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65d314c9-a33b-4ab4-966a-d6418e003907" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.376030] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1182.376030] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a deletion is rescheduled due to dependency. [ 1182.376187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.376459] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.376504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.376695] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.376820] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.376914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.377128] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.377245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.377371] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.854028] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 in Status: SUCCESS [ 1182.854398] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 deletion is rescheduled due to dependency. [ 1182.854398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.879724] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.381824] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.884789] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.885137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.885137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.885307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.885307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.885409] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1183.911516] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.911687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.911760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.911965] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.912121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.919620] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1185.932799] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.932799] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.932799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.932799] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.072117] env[70287]: INFO networking_nsxv3.common.synchronization [req-566adbf1-2458-4a71-aae9-5286494fd23c req-b74a40bd-77ee-4e55-8140-270f5361a88e tempest-ServersNegativeTestMultiTenantJSON-1302376580 tempest-ServersNegativeTestMultiTenantJSON-1302376580-project-member] Enqueued Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_members [ 1186.072117] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_members [ 1186.072117] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfdeb689-9125-4539-8334-df005ec5e68f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.072117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.072117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.072117] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.072554] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.072818] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.074230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.074230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.074230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.074230] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.340589] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-599 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.340741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.340876] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.341153] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.341406] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.341561] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.341680] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.341896] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.342061] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.342275] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.342392] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.342501] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.342612] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.342720] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1186.342827] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.342959] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.365555] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.365718] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1186.365859] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.366044] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-599" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.366351] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-84f8ec5c-7814-4548-a936-96ac3b4b7071 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.366931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.366931] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.367083] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.367128] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84f8ec5c-7814-4548-a936-96ac3b4b7071',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.435122] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.576193] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.576365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.576448] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.576659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.576758] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.576961] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.577075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.577132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.577286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.577360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.577442] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfdeb689-9125-4539-8334-df005ec5e68f already deleted. [ 1186.577522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.869120] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.869364] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.869539] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.869862] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.870040] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.870206] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 84f8ec5c-7814-4548-a936-96ac3b4b7071 not found, creating... [ 1186.870479] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.870648] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.870776] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.871010] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.871182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.871512] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.871672] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.871792] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.872085] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.872182] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.872326] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 84f8ec5c-7814-4548-a936-96ac3b4b7071 is going to be created. [ 1186.892318] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.892459] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.892571] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.892819] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.893032] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.893258] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.937325] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02bff0b8-b4e7-47de-bf5e-9f794b64958a: rpc.has_security_group_logging(os_id): False [ 1186.965948] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.966136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.966190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.966437] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.966533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.966816] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.966955] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.967020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.967194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.967307] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.967422] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1187.044209] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.044360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.044436] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.044646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.044788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.060154] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1187.593488] env[70287]: INFO networking_nsxv3.common.synchronization [req-566adbf1-2458-4a71-aae9-5286494fd23c req-4cbab528-b255-4c11-9eef-e0bd232a8621 service nova] Enqueued Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_rules [ 1187.593488] env[70287]: INFO networking_nsxv3.common.synchronization [req-566adbf1-2458-4a71-aae9-5286494fd23c req-4cbab528-b255-4c11-9eef-e0bd232a8621 service nova] Enqueued Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_members [ 1187.593488] env[70287]: INFO networking_nsxv3.common.synchronization [req-566adbf1-2458-4a71-aae9-5286494fd23c req-4cbab528-b255-4c11-9eef-e0bd232a8621 service nova] Enqueued Resource ID: 84f8ec5c-7814-4548-a936-96ac3b4b7071 with Priority: HIGHEST for action port [ 1187.593856] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_rules [ 1187.593991] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_members [ 1187.594222] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f8ec5c-7814-4548-a936-96ac3b4b7071 with Priority: HIGHEST for action port [ 1187.594598] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cfdeb689-9125-4539-8334-df005ec5e68f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.594691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.594691] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.595068] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.595068] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.596301] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfdeb689-9125-4539-8334-df005ec5e68f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.596526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.596600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.596774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.596919] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.597020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.597082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.597217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.597482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.597482] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.598472] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-84f8ec5c-7814-4548-a936-96ac3b4b7071 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.598586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.598767] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.598926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.599015] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84f8ec5c-7814-4548-a936-96ac3b4b7071',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.097677] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfdeb689-9125-4539-8334-df005ec5e68f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.098050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.099250] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.100942] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84f8ec5c-7814-4548-a936-96ac3b4b7071 with status ACTIVE [ 1188.101694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.101694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.101694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.101694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.102009] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.102148] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.102253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.102317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.102519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.102583] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.102731] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.102823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.102907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.103030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.103151] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.103231] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84f8ec5c-7814-4548-a936-96ac3b4b7071 is going to be updated. [ 1188.123114] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.123265] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.123326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.123509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.123640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.123790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84f8ec5c-7814-4548-a936-96ac3b4b7071" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.602103] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.073924] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1189.074175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.104794] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.105091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.105157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.105430] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.105532] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.105635] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfdeb689-9125-4539-8334-df005ec5e68f is going to be created. [ 1189.131267] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.131451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.131502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.131746] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.131910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.141436] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfdeb689-9125-4539-8334-df005ec5e68f in Status: UNINITIALIZED for 2s [ 1190.614197] env[70287]: INFO networking_nsxv3.common.synchronization [req-449d1743-649b-4f6d-9055-6ac5a094757a req-fd681f23-8b23-4812-ada4-8713b466e679 tempest-AttachVolumeShelveTestJSON-1450012594 tempest-AttachVolumeShelveTestJSON-1450012594-project-member] Enqueued Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1190.614786] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 with Priority: HIGHEST for action security_group_members [ 1190.614987] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.615121] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.615180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.615380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.615558] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.615659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.615719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.615869] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.615953] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.616056] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d139a12c-73ef-4c1b-a08c-ef24b2ea3b83',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.117882] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.118135] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.118244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.118561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.118657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.118923] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.119049] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.119107] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.119267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.119343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.119514] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 is going to be updated. [ 1191.146361] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.146558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.146558] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.146701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.146830] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.155196] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: IN_PROGRESS for 2s [ 1191.155823] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfdeb689-9125-4539-8334-df005ec5e68f in Status: SUCCESS [ 1191.156013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.156162] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.156344] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.156516] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.156640] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.156698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.156822] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.156899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.156982] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.157081] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.659441] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfdeb689-9125-4539-8334-df005ec5e68f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.660016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.660016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.660016] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.660262] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.660460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.660684] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.660759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.660861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.660914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.661091] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfdeb689-9125-4539-8334-df005ec5e68f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.661188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.661254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.661458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.661617] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.661715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.661774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.661957] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.662050] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.662155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.662272] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.164292] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cfdeb689-9125-4539-8334-df005ec5e68f: rpc.has_security_group_logging(os_id): False [ 1192.183788] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.183945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.184030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.184279] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.184375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.184791] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.184899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.184949] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.185125] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.185237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.185493] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.185618] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.185717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.185890] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.185966] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.186169] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.186266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.186335] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.186481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.186557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.186644] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cfdeb689-9125-4539-8334-df005ec5e68f is going to be created. [ 1192.252051] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.252277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.252277] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.252500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.252698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.262222] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfdeb689-9125-4539-8334-df005ec5e68f in Status: IN_PROGRESS for 2s [ 1193.163641] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 in Status: SUCCESS [ 1193.164020] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d139a12c-73ef-4c1b-a08c-ef24b2ea3b83 deletion is rescheduled due to dependency. [ 1193.164020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d139a12c-73ef-4c1b-a08c-ef24b2ea3b83" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.273296] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cfdeb689-9125-4539-8334-df005ec5e68f in Status: SUCCESS [ 1194.273652] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.616214] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1195.616555] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1196.609998] env[70287]: INFO networking_nsxv3.common.synchronization [req-da11bd36-ba7e-4b6e-aff1-d1a1bebe022c req-dfd789d2-da90-4db5-ad32-76416a028962 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1196.610242] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1196.610343] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.610482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.610572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.610756] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.610911] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.611017] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.611082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.611229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.611345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.611400] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.886820] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.887202] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.887202] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.887491] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.887778] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.887958] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.888111] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.888358] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.888577] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.888838] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.888970] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1196.889116] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1196.889232] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1196.889357] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1196.889478] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1196.889629] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1196.910804] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1196.910989] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1196.911191] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1196.911392] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.911713] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-004b1bb1-eace-4b83-88e8-7573660ca829 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.911905] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.912038] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.912392] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.912534] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004b1bb1-eace-4b83-88e8-7573660ca829',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.116631] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.116825] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.116901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.117157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.117354] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.117458] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.117557] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.117631] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.117789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.117877] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.117966] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1197.158182] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.158359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.158473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.158649] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.158804] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.166630] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1197.399199] env[70287]: INFO networking_nsxv3.common.synchronization [req-bae5eb1c-19a1-42c0-8d7a-1c34996a4906 req-73941d08-93e8-4f06-848a-57bbb7cdda77 tempest-ServersNegativeTestMultiTenantJSON-1302376580 tempest-ServersNegativeTestMultiTenantJSON-1302376580-project-member] Enqueued Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_members [ 1197.399698] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfdeb689-9125-4539-8334-df005ec5e68f with Priority: HIGHEST for action security_group_members [ 1197.400068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-cfdeb689-9125-4539-8334-df005ec5e68f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.400229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.400323] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.400552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.400763] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.400943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.401078] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.401554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.401554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.401693] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cfdeb689-9125-4539-8334-df005ec5e68f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.415051] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.415607] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.415607] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.415753] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.415887] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.416075] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 004b1bb1-eace-4b83-88e8-7573660ca829 not found, creating... [ 1197.416522] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.417053] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.417213] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.417566] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.417637] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.418052] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.418261] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.418393] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.418714] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.418920] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.419146] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 004b1bb1-eace-4b83-88e8-7573660ca829 is going to be created. [ 1197.442776] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.443097] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.443292] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.443797] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.443979] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.444295] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.903949] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.904278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.904278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.904405] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.904502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.904699] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.904795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.904855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.905011] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.905099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.905187] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfdeb689-9125-4539-8334-df005ec5e68f is going to be updated. [ 1197.928627] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.928753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.928851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.928997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.929148] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.936930] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfdeb689-9125-4539-8334-df005ec5e68f in Status: IN_PROGRESS for 2s [ 1198.185030] env[70287]: INFO networking_nsxv3.common.synchronization [req-da11bd36-ba7e-4b6e-aff1-d1a1bebe022c req-18762691-daaa-4696-8c31-127fc241fcc8 service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 1198.185271] env[70287]: INFO networking_nsxv3.common.synchronization [req-da11bd36-ba7e-4b6e-aff1-d1a1bebe022c req-18762691-daaa-4696-8c31-127fc241fcc8 service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1198.185556] env[70287]: INFO networking_nsxv3.common.synchronization [req-da11bd36-ba7e-4b6e-aff1-d1a1bebe022c req-18762691-daaa-4696-8c31-127fc241fcc8 service nova] Enqueued Resource ID: 004b1bb1-eace-4b83-88e8-7573660ca829 with Priority: HIGHEST for action port [ 1198.186361] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 1198.186580] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1198.186766] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004b1bb1-eace-4b83-88e8-7573660ca829 with Priority: HIGHEST for action port [ 1198.187202] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.187390] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.187513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.187827] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.187960] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.189141] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.189312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.189607] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-004b1bb1-eace-4b83-88e8-7573660ca829 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.189760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.189875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.190191] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.190295] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004b1bb1-eace-4b83-88e8-7573660ca829',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.692244] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.692385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.692640] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 004b1bb1-eace-4b83-88e8-7573660ca829 with status ACTIVE [ 1198.692871] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.693032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.693129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.693398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.693533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.693765] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.693905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.693998] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.694219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.694332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.694595] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.694733] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.694828] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.695039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.695152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.695277] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 004b1bb1-eace-4b83-88e8-7573660ca829 is going to be updated. [ 1198.715247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.715370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.715418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.715568] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.715695] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.715846] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.175317] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1199.175646] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f deletion is rescheduled due to dependency. [ 1199.175646] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.175782] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.176058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.176346] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.176346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.176346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.176555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.176692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.176692] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.679087] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.946110] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cfdeb689-9125-4539-8334-df005ec5e68f in Status: SUCCESS [ 1199.946295] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cfdeb689-9125-4539-8334-df005ec5e68f deletion is rescheduled due to dependency. [ 1199.946440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cfdeb689-9125-4539-8334-df005ec5e68f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.181446] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.638134] env[70287]: INFO networking_nsxv3.common.synchronization [req-45b05a79-7b0f-4a00-b446-a3a561a489f6 req-e799a2c5-f6ef-491a-aad2-ce859bbaf3a7 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1200.638670] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1200.638670] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.638670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.638670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.638946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.639158] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.639158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.639274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.639345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.639398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.639483] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.685666] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.685666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.685666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.685666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.685666] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.685666] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1200.711431] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.711431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.711431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.711431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.711661] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.719872] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1200.962335] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.962542] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.962674] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.962942] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.963215] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.963378] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.963544] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.963740] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.963889] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.964118] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.964238] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1200.964353] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1200.964467] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1200.964626] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1200.964778] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1200.964935] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1200.983570] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1200.983741] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1200.983872] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1200.984069] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.984371] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-802dc3e6-e351-4c94-a937-058f36a6d93c taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.984543] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.984669] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.984975] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.985130] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802dc3e6-e351-4c94-a937-058f36a6d93c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.141798] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.142203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.142203] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.142368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.162356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.162356] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.162356] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.162572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.162605] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.162692] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.162795] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be updated. [ 1201.211706] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.211706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.211706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.211706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.211706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.222184] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: IN_PROGRESS for 2s [ 1201.487233] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.487569] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.487748] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.488108] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.488220] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.488513] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 802dc3e6-e351-4c94-a937-058f36a6d93c not found, creating... [ 1201.488705] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.489152] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.489152] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.489305] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.489549] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.489789] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.490028] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.490094] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.490308] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.490707] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.490707] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 802dc3e6-e351-4c94-a937-058f36a6d93c is going to be created. [ 1201.516503] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.516774] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.516923] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.517226] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.517461] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.517697] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.181475] env[70287]: INFO networking_nsxv3.common.synchronization [req-45b05a79-7b0f-4a00-b446-a3a561a489f6 req-8cee76eb-c263-4fa3-989d-6f61a9067ef1 service nova] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_rules [ 1202.181685] env[70287]: INFO networking_nsxv3.common.synchronization [req-45b05a79-7b0f-4a00-b446-a3a561a489f6 req-8cee76eb-c263-4fa3-989d-6f61a9067ef1 service nova] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1202.181839] env[70287]: INFO networking_nsxv3.common.synchronization [req-45b05a79-7b0f-4a00-b446-a3a561a489f6 req-8cee76eb-c263-4fa3-989d-6f61a9067ef1 service nova] Enqueued Resource ID: 802dc3e6-e351-4c94-a937-058f36a6d93c with Priority: HIGHEST for action port [ 1202.182090] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_rules [ 1202.182233] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1202.182390] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802dc3e6-e351-4c94-a937-058f36a6d93c with Priority: HIGHEST for action port [ 1202.182889] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.183034] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.183110] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.183318] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.183404] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.184224] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.184322] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.184545] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-802dc3e6-e351-4c94-a937-058f36a6d93c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.184656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.184724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.184988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.185080] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802dc3e6-e351-4c94-a937-058f36a6d93c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.688379] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.688657] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.688730] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 802dc3e6-e351-4c94-a937-058f36a6d93c with status ACTIVE [ 1202.688971] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.689082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.689082] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.689276] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.689370] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.689534] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.689621] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.689682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.689832] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.689910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.690121] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.690211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.690267] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.690408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.690482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.690568] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 802dc3e6-e351-4c94-a937-058f36a6d93c is going to be updated. [ 1202.712759] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.712889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.712963] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.713160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.713292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.713444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.748049] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1202.748603] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.748694] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.748970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.749252] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.749444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.749795] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.749873] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.749975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.750130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.750311] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.232111] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: SUCCESS [ 1203.232302] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 deletion is rescheduled due to dependency. [ 1203.232414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.232571] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.232826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.233028] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.233155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.233229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.237021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.237021] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.237021] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.255778] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.738924] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.761103] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f: rpc.has_security_group_logging(os_id): False [ 1203.777982] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.778194] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.778682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.778981] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.779195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.779459] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.779787] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.780089] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.780398] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.780608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.780678] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1203.843109] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.843349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.843349] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.843561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.843561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.856721] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1204.244049] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.748565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.750484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.750484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.750484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.750484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.750484] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be updated. [ 1204.777673] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.777673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.777673] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.777960] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.778912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.788639] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: IN_PROGRESS for 2s [ 1205.874024] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1205.874024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.797849] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: SUCCESS [ 1206.798109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.798289] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.798509] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.798722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.798841] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.798914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.799114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.799201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.799299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.799412] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.183825] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1207.184377] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1207.301727] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.301943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.301943] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.302198] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.302365] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.302471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.302569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.302693] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.302778] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.302867] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.303168] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.303168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.303168] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.303320] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.303437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.303529] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.303592] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.303781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.303865] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.303951] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.304056] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.808473] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 046d93ea-504a-4a85-9ee9-25113ed9b167: rpc.has_security_group_logging(os_id): False [ 1207.828855] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.828855] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.828855] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.828855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.829489] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.829489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.829489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.829489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.829489] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.829489] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be updated. [ 1207.890430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.890581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.890655] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.890954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.891175] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.903326] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: IN_PROGRESS for 2s [ 1209.918487] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: SUCCESS [ 1209.918871] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.821628] env[70287]: INFO networking_nsxv3.common.synchronization [req-94e2a8f3-941f-47d8-a3bc-e7f5a5c9d656 req-16de46e1-895d-473c-9fb8-534aeb9f7f4d tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1210.822194] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGHEST for action security_group_members [ 1210.822510] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.822707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.822707] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.822926] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.823206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.823343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.823412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.823573] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.823659] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.823749] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.862285] env[70287]: INFO networking_nsxv3.common.synchronization [req-94e2a8f3-941f-47d8-a3bc-e7f5a5c9d656 req-16de46e1-895d-473c-9fb8-534aeb9f7f4d tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: 802dc3e6-e351-4c94-a937-058f36a6d93c with Priority: HIGHEST for action port [ 1210.862796] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 802dc3e6-e351-4c94-a937-058f36a6d93c with Priority: HIGHEST for action port [ 1210.863159] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-802dc3e6-e351-4c94-a937-058f36a6d93c taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.863319] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.863407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.863637] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.863747] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('802dc3e6-e351-4c94-a937-058f36a6d93c',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.325985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.326306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.326306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.326461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.326553] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.326762] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.326910] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.326974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.327152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.327233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.327349] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be updated. [ 1211.360760] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.360924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.360970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.361201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.361336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.365833] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 802dc3e6-e351-4c94-a937-058f36a6d93c with status ACTIVE [ 1211.366009] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.366124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.366189] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.366361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.366443] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.366653] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.366727] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.366789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.366932] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.367039] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.367272] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.367457] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.367491] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.367697] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.367799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.367922] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 802dc3e6-e351-4c94-a937-058f36a6d93c is going to be updated. [ 1211.370705] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: IN_PROGRESS for 2s [ 1211.385520] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.385644] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.385712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.385898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.386041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.386195] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-802dc3e6-e351-4c94-a937-058f36a6d93c" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.380974] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 in Status: SUCCESS [ 1213.381442] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 deletion is rescheduled due to dependency. [ 1213.381442] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.864252] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.864660] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1220.865919] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1220.866219] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1225.867815] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1225.868130] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1230.869164] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1230.869505] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1233.598561] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1233.598815] env[70287]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7b19a7f8-c2db-440a-ac16-2630990ba02e None None] NSXv3 Agent Agent loop - iteration:3 started [ 1235.828753] env[70287]: INFO networking_nsxv3.common.synchronization [req-6c174a36-087d-462c-9894-c05f40f84c03 req-8ab60719-335b-4027-97a8-5c3e8b9ebfe6 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1235.829326] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1235.829643] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.829768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.829829] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.830219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.830384] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.830486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.830543] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.830702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.830789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.830885] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.140461] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-887 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.140667] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.140799] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.141095] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.141366] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.141534] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.141656] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.141891] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.142054] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.142290] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.142411] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.142525] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.142637] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.142749] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1236.142858] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.142997] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.161009] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.161190] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1236.161342] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.161510] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-887" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.161778] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.161939] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.162084] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.162376] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.162514] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8274f92-8ee3-4eec-a4ef-8bb9ad8838be',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.332544] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.664611] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.664854] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.664987] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.665297] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.665455] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.665614] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port f8274f92-8ee3-4eec-a4ef-8bb9ad8838be not found, creating... [ 1236.665880] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.666054] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.666176] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.666405] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.666545] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.666825] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.666992] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.667128] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.667342] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.667478] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.667620] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: f8274f92-8ee3-4eec-a4ef-8bb9ad8838be is going to be created. [ 1236.688041] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.688261] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.688390] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.688729] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.689041] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.689272] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.835012] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.337726] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.337903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.337980] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.338439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.338439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.338439] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be updated. [ 1237.365961] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.366115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.366219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.366383] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.366520] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.368169] env[70287]: INFO networking_nsxv3.common.synchronization [req-6c174a36-087d-462c-9894-c05f40f84c03 req-1b227dd9-4ce4-4cd9-8ecf-e12b28b64d10 service nova] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 1237.368930] env[70287]: INFO networking_nsxv3.common.synchronization [req-6c174a36-087d-462c-9894-c05f40f84c03 req-1b227dd9-4ce4-4cd9-8ecf-e12b28b64d10 service nova] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1237.368930] env[70287]: INFO networking_nsxv3.common.synchronization [req-6c174a36-087d-462c-9894-c05f40f84c03 req-1b227dd9-4ce4-4cd9-8ecf-e12b28b64d10 service nova] Enqueued Resource ID: f8274f92-8ee3-4eec-a4ef-8bb9ad8838be with Priority: HIGHEST for action port [ 1237.369062] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_rules [ 1237.369143] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1237.369219] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8274f92-8ee3-4eec-a4ef-8bb9ad8838be with Priority: HIGHEST for action port [ 1237.371686] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.371686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.371686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.371686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.371686] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.371686] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.371686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.372053] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.372053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.372053] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.372183] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.372183] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8274f92-8ee3-4eec-a4ef-8bb9ad8838be',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.377384] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 1237.875586] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.875586] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.875850] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f8274f92-8ee3-4eec-a4ef-8bb9ad8838be with status ACTIVE [ 1237.876068] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.876167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.876258] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.876525] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.876643] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.876903] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.877048] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.877114] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.877306] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.877413] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.877662] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.877791] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.877876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.878083] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.878187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.878303] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f8274f92-8ee3-4eec-a4ef-8bb9ad8838be is going to be updated. [ 1237.898810] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.899032] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.899134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.899245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.899373] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.899522] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8274f92-8ee3-4eec-a4ef-8bb9ad8838be" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.387166] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 1239.387623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.387623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.388152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.388152] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.388152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.388152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.388360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.388360] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.388450] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.890122] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.392507] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.895031] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.895031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.895031] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.895367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.895367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.895367] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be updated. [ 1240.923843] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.924047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.924047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.924237] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.924375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.933436] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 1242.369862] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1242.370322] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1242.945253] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 1242.945471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.945611] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.945813] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.946904] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.946904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.946904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.946904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.946904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.946904] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.946904] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.449548] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.560523] env[70287]: INFO networking_nsxv3.common.synchronization [req-b8ed28e3-8b0d-4e2d-8d4d-6e2c6a9aa005 req-68214bb6-8fcd-4360-a035-fdd0c40ecc00 tempest-ServerActionsTestJSON-1434509149 tempest-ServerActionsTestJSON-1434509149-project-member] Enqueued Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1243.560523] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a with Priority: HIGHEST for action security_group_members [ 1243.560523] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-02bff0b8-b4e7-47de-bf5e-9f794b64958a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.560901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.560901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.560901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.561094] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.561181] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.561242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.561821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.561821] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.561821] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02bff0b8-b4e7-47de-bf5e-9f794b64958a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.952826] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2d197f8-6ecf-4737-ae78-a66d15978937: rpc.has_security_group_logging(os_id): False [ 1243.969777] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.969921] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.969985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.970224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.970355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.971347] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.971347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.971347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.971347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.971347] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.971347] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be updated. [ 1244.027278] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.028801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.029196] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.029768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.029985] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.043363] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 1244.064025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.064228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.064228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.064513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.064513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.064706] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.064802] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.064862] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.065015] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.065100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.065610] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a is going to be updated. [ 1244.093496] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.093639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.093698] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.093897] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.094060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.108736] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 2s [ 1246.056498] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 1246.056986] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.118107] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: IN_PROGRESS for 4s [ 1248.129403] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a in Status: SUCCESS [ 1248.129779] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02bff0b8-b4e7-47de-bf5e-9f794b64958a deletion is rescheduled due to dependency. [ 1248.129779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02bff0b8-b4e7-47de-bf5e-9f794b64958a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.561888] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1248.561888] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1251.704038] env[70287]: INFO networking_nsxv3.common.synchronization [None req-729e85fd-450a-4533-8aff-eba434ff84b2 None None] Enqueued Resource ID: eead1858-d11c-4c73-a3ae-583df813a05f with Priority: HIGHEST for action port [ 1251.704307] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eead1858-d11c-4c73-a3ae-583df813a05f with Priority: HIGHEST for action port [ 1251.704910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-eead1858-d11c-4c73-a3ae-583df813a05f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.705129] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eead1858-d11c-4c73-a3ae-583df813a05f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.705208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eead1858-d11c-4c73-a3ae-583df813a05f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.705408] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eead1858-d11c-4c73-a3ae-583df813a05f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.705485] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eead1858-d11c-4c73-a3ae-583df813a05f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.211075] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eead1858-d11c-4c73-a3ae-583df813a05f [ 1252.211075] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.211075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.211075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.211075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.211075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.211075] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eead1858-d11c-4c73-a3ae-583df813a05f already deleted. [ 1252.211075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eead1858-d11c-4c73-a3ae-583df813a05f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.656371] env[70287]: INFO networking_nsxv3.common.synchronization [None req-5c7ec830-5890-472a-9532-c0f134092b76 None None] Enqueued Resource ID: 487ba8ec-dda4-4f51-bff3-a01d748fe174 with Priority: HIGHEST for action port [ 1255.658116] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 487ba8ec-dda4-4f51-bff3-a01d748fe174 with Priority: HIGHEST for action port [ 1255.658116] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-487ba8ec-dda4-4f51-bff3-a01d748fe174 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.658116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-487ba8ec-dda4-4f51-bff3-a01d748fe174" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.658116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-487ba8ec-dda4-4f51-bff3-a01d748fe174" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.658116] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-487ba8ec-dda4-4f51-bff3-a01d748fe174" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.658116] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('487ba8ec-dda4-4f51-bff3-a01d748fe174',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.161286] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 487ba8ec-dda4-4f51-bff3-a01d748fe174 [ 1256.161390] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.162314] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.163201] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.163449] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.163913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.163913] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:487ba8ec-dda4-4f51-bff3-a01d748fe174 already deleted. [ 1256.163913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-487ba8ec-dda4-4f51-bff3-a01d748fe174" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.601418] env[70287]: INFO networking_nsxv3.common.synchronization [None req-c1548c24-97d9-4187-9904-478939571f34 None None] Enqueued Resource ID: 342d148a-f97f-4cc6-b479-bd38e6b7f8ef with Priority: HIGHEST for action port [ 1257.602412] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 342d148a-f97f-4cc6-b479-bd38e6b7f8ef with Priority: HIGHEST for action port [ 1257.604119] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-342d148a-f97f-4cc6-b479-bd38e6b7f8ef taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.604385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-342d148a-f97f-4cc6-b479-bd38e6b7f8ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.604526] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-342d148a-f97f-4cc6-b479-bd38e6b7f8ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.604889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-342d148a-f97f-4cc6-b479-bd38e6b7f8ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.604990] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('342d148a-f97f-4cc6-b479-bd38e6b7f8ef',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.107456] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 342d148a-f97f-4cc6-b479-bd38e6b7f8ef [ 1258.107685] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.107823] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.107895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.108132] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.108229] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.108324] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:342d148a-f97f-4cc6-b479-bd38e6b7f8ef already deleted. [ 1258.108406] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-342d148a-f97f-4cc6-b479-bd38e6b7f8ef" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.714492] env[70287]: INFO networking_nsxv3.common.synchronization [req-f4ae1ef4-fded-42c4-9fcd-a631e0147b81 req-4ce9a72d-5dc4-4f32-99da-d812f20050cb tempest-ServerMetadataTestJSON-595114665 tempest-ServerMetadataTestJSON-595114665-project-member] Enqueued Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_members [ 1260.715078] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_members [ 1260.715142] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.715245] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.715311] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.715560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.715713] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.715812] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.715875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.716036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.716122] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.716209] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.180941] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-897 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.181189] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.181325] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.181690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.181995] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.182309] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.182461] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.182691] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.182841] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.183061] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.183223] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1261.183301] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1261.183410] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1261.183523] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1261.183663] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1261.183811] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1261.202505] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1261.202650] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1261.202787] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1261.202954] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-897" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.203251] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-2c025f94-e6de-49d5-a8c4-cdb17123d556 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.203415] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.203538] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.203824] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.203985] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c025f94-e6de-49d5-a8c4-cdb17123d556',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.218330] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.219274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.219393] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.219609] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.219702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.219890] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.219993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.220071] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.220231] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.220317] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.220401] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738e5731-ace4-4b5c-98da-61384bf20f80 already deleted. [ 1261.220481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.706438] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.706723] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.706856] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.707531] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.707705] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.707869] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 2c025f94-e6de-49d5-a8c4-cdb17123d556 not found, creating... [ 1261.708162] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.708326] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.708475] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.708706] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.708849] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.709149] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.709333] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.709456] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.709702] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.709857] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.710010] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 2c025f94-e6de-49d5-a8c4-cdb17123d556 is going to be created. [ 1261.729662] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1261.729979] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1261.729979] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1261.730286] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1261.730587] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1261.730816] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.530214] env[70287]: INFO networking_nsxv3.common.synchronization [req-f4ae1ef4-fded-42c4-9fcd-a631e0147b81 req-12b383f3-ab3a-43ee-8924-5728357cfb5f service nova] Enqueued Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_rules [ 1262.530214] env[70287]: INFO networking_nsxv3.common.synchronization [req-f4ae1ef4-fded-42c4-9fcd-a631e0147b81 req-12b383f3-ab3a-43ee-8924-5728357cfb5f service nova] Enqueued Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_members [ 1262.530214] env[70287]: INFO networking_nsxv3.common.synchronization [req-f4ae1ef4-fded-42c4-9fcd-a631e0147b81 req-12b383f3-ab3a-43ee-8924-5728357cfb5f service nova] Enqueued Resource ID: 2c025f94-e6de-49d5-a8c4-cdb17123d556 with Priority: HIGHEST for action port [ 1262.530214] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_rules [ 1262.530214] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_members [ 1262.530214] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c025f94-e6de-49d5-a8c4-cdb17123d556 with Priority: HIGHEST for action port [ 1262.530214] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.530214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.530214] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.531137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.531578] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.532760] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.533419] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.534217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.534217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.534217] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.534217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.534217] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.535100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.535100] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.535100] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.536206] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c025f94-e6de-49d5-a8c4-cdb17123d556 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.536206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.536206] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.536470] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.536470] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c025f94-e6de-49d5-a8c4-cdb17123d556',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.038422] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.038729] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.038729] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.042461] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c025f94-e6de-49d5-a8c4-cdb17123d556 with status ACTIVE [ 1263.042722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.043216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.043216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.043216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.043216] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.043405] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.043508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.043569] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.044025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.044025] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.044025] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.044147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.044147] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.044241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.044332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.044397] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c025f94-e6de-49d5-a8c4-cdb17123d556 is going to be updated. [ 1263.064104] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.064238] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.064300] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.064483] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.064620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.064775] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c025f94-e6de-49d5-a8c4-cdb17123d556" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.546843] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1264.049241] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.049241] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.049481] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.049600] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.049700] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.049821] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738e5731-ace4-4b5c-98da-61384bf20f80 is going to be created. [ 1264.075569] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.075715] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.075789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.075997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.076169] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.084972] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: UNINITIALIZED for 2s [ 1266.096023] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: SUCCESS [ 1266.096291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.096418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.096625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.096814] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.096930] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.096994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.097158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.097244] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.097326] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.097411] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.599710] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.600046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.600046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.600149] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.600314] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.600469] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.600511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.600671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.600757] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.600850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.600995] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.601096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.601172] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.601301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.601437] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.601533] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.601606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.601762] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.601842] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.601920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.602014] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.104657] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 738e5731-ace4-4b5c-98da-61384bf20f80: rpc.has_security_group_logging(os_id): False [ 1267.122090] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.122090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.122090] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.122285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.122285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.122464] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.122564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.122627] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.122779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.122859] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.123066] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.123164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.123224] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.123359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.123435] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.123619] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.123952] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.124042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.124170] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.124254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.124350] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 738e5731-ace4-4b5c-98da-61384bf20f80 is going to be created. [ 1267.181928] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.182178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.182178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.182377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.182560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.192466] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: IN_PROGRESS for 2s [ 1267.530323] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1267.530475] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1267.542111] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.542358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.542467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.542768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.542944] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.045791] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.548852] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.051759] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1269.051904] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1269.208669] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: SUCCESS [ 1269.208900] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.767143] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.767560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.767560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.767560] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.779439] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1269.780412] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.781500] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1269.816449] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.816625] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.816667] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.816848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.828365] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.829155] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1269.829237] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1269.829350] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1269.867565] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.867755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.867755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.867968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.869377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.869636] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1269.938122] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.938280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.938358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.938559] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.938880] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.939186] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1270.015043] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.015219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.015290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.015467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.015774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.016110] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:48. [ 1270.016194] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f', '738e5731-ace4-4b5c-98da-61384bf20f80', '84f1f591-bba8-479c-a2de-cf9524dceb77', '521389fe-7ad3-45db-944a-1438ff593c45', 'ea613e25-cc1d-4b11-9ac5-2be1d0651607', 'd6a1c404-909c-4d2a-8a7d-03a5e01c1417', '7e5e0f30-956b-4713-b190-79d66c86985e', 'ba5bbcb7-2707-4cc4-9fe9-50838165cb90', 'd6c2a27e-83db-4022-a129-8e3459a8cda6', '190b5a64-9816-4072-acb7-4bc2c9f8f4b9', 'b2d197f8-6ecf-4737-ae78-a66d15978937', 'fab56e40-0f11-4047-a55f-7256f2c35ef8', 'df66c1e2-6914-41c1-a5ac-eb133438cab6', '7fa9a372-83e3-4430-bfa3-b4320a4cc0fe', '3fa85bd5-519a-4ab3-885c-dd87b56fc10a', 'd87c2dce-8258-430c-b549-6c6bfe5f0943', '66c1d37b-c5db-46f6-a3a7-fba9859cd91e', 'ae697c95-678e-4288-aec7-3a6fe1dee306', '1bd48e89-cc58-4469-862d-723098d8ef49', '046d93ea-504a-4a85-9ee9-25113ed9b167', '10ebe6dc-47f0-434b-95e1-44ef22b9a387', 'aace6632-4a31-4f49-8463-d0be4cce8713', '6e14022e-50e8-464a-97d9-95650f41cb7b', 'ac98ad7d-21c7-4c9e-add9-9d7467bf4897', '00cd6f54-b66d-4d65-84a8-02e8042ea31d', 'c7801a11-9fa5-48e7-852a-cce31e8a5030', '440e3530-396b-4e0b-b2b9-e88ce8edefb7', '3e02cb19-0821-42f3-a922-f67afc4bab0d', '09ec1027-1b0d-4599-b91d-8dcf34cbb08e', '306ade67-3f30-492d-a51d-d4eb542da01d', '3fe525ed-6fed-4da6-b1de-de2234e26337', '03f7a97c-14e5-4707-a109-e07660e131ff', 'eed43c9b-e09e-4fd2-87aa-ee48b0ab6706', '15c84255-e5bf-4821-86ca-a3b374c86875', 'f23e3805-622c-45be-b03e-1e0963f7a65e', 'e268cb7c-d939-4cae-9df0-54709ed24656', 'f041a33f-3065-4123-b535-0695dd2dbb6f', 'eb04e66f-c59f-46c7-add9-c2a370e670cd', '0c8498fc-c714-4100-81f9-c85ac268aab7', 'd139a12c-73ef-4c1b-a08c-ef24b2ea3b83', 'b7e1295d-86bf-45fa-b2c1-808d7d01f3ea', '6e412cd2-d48e-4d56-bb8c-6bca0756dff0', 'cfdeb689-9125-4539-8334-df005ec5e68f', 'e6ce8eb0-1f95-4fbe-ad32-829aa60405a9', 'eff65c9c-e65e-4eb7-8f84-5f8a0c9b6a40', '6326b8c2-c4f1-4b56-863e-ab5aeeaf035d', '35b6a470-77b3-4223-87b5-475c69bf4519', '02bff0b8-b4e7-47de-bf5e-9f794b64958a'} {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.016291] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1270.033870] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.034020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.034066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.034274] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.034363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.034474] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1270.034545] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.034608] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1270.102193] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.102391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.102391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.102589] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.103815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.104299] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1270.104299] env[70287]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=70287) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.104299] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1270.104433] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1270.104433] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/48 resources of Type:Security Group Rules [ 1270.104528] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGH for action security_group_rules [ 1270.104591] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGH for action security_group_rules [ 1270.104656] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGH for action security_group_rules [ 1270.104718] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGH for action security_group_rules [ 1270.104779] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGH for action security_group_rules [ 1270.104841] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGH for action security_group_rules [ 1270.104902] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGH for action security_group_rules [ 1270.104962] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGH for action security_group_rules [ 1270.105034] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGH for action security_group_rules [ 1270.105096] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGH for action security_group_rules [ 1270.105157] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGH for action security_group_rules [ 1270.105212] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGH for action security_group_rules [ 1270.105273] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGH for action security_group_rules [ 1270.105352] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGH for action security_group_rules [ 1270.105420] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGH for action security_group_rules [ 1270.105481] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGH for action security_group_rules [ 1270.105541] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGH for action security_group_rules [ 1270.105603] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGH for action security_group_rules [ 1270.105664] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGH for action security_group_rules [ 1270.105726] env[70287]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGH for action security_group_rules [ 1270.105883] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.764979] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-910 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.765214] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.765341] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.765606] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.765861] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.766030] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.766233] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.766572] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.766736] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.766946] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.767079] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1270.767298] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1270.767522] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1270.767620] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1270.767740] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1270.767880] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1270.784412] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1270.784575] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1270.784709] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1270.784871] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-910" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.785167] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-004b1bb1-eace-4b83-88e8-7573660ca829 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.785331] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.785462] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.785690] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.785825] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004b1bb1-eace-4b83-88e8-7573660ca829',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.289038] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.289271] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.289397] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.289714] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.289868] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.290185] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.290374] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.290504] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.290741] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.290871] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.291168] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.291323] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.291481] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.291767] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.291840] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.291983] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 004b1bb1-eace-4b83-88e8-7573660ca829 is going to be updated. [ 1271.315176] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.315404] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.315527] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.315851] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.316084] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.316350] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.068080] env[70287]: INFO networking_nsxv3.common.synchronization [req-8fa373c2-1a3d-4de8-b16d-f3cb71f1676f req-1eea91bd-0750-4533-b27d-5a6dc5af84d8 service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 1272.068299] env[70287]: INFO networking_nsxv3.common.synchronization [req-8fa373c2-1a3d-4de8-b16d-f3cb71f1676f req-1eea91bd-0750-4533-b27d-5a6dc5af84d8 service nova] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1272.068326] env[70287]: INFO networking_nsxv3.common.synchronization [req-8fa373c2-1a3d-4de8-b16d-f3cb71f1676f req-1eea91bd-0750-4533-b27d-5a6dc5af84d8 service nova] Enqueued Resource ID: 004b1bb1-eace-4b83-88e8-7573660ca829 with Priority: HIGHEST for action port [ 1272.068557] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_rules [ 1272.068697] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1272.068799] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 004b1bb1-eace-4b83-88e8-7573660ca829 with Priority: HIGHEST for action port [ 1272.068895] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGH for action security_group_rules [ 1272.068983] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 with Priority: HIGH for action security_group_rules [ 1272.069118] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e5e0f30-956b-4713-b190-79d66c86985e with Priority: HIGH for action security_group_rules [ 1272.069181] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a with Priority: HIGH for action security_group_rules [ 1272.069267] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 with Priority: HIGH for action security_group_rules [ 1272.069376] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd48e89-cc58-4469-862d-723098d8ef49 with Priority: HIGH for action security_group_rules [ 1272.069701] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae697c95-678e-4288-aec7-3a6fe1dee306 with Priority: HIGH for action security_group_rules [ 1272.069701] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e with Priority: HIGH for action security_group_rules [ 1272.069701] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe with Priority: HIGH for action security_group_rules [ 1272.069701] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 with Priority: HIGH for action security_group_rules [ 1272.069827] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 with Priority: HIGH for action security_group_rules [ 1272.069858] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 with Priority: HIGH for action security_group_rules [ 1272.069943] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGH for action security_group_rules [ 1272.070200] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 with Priority: HIGH for action security_group_rules [ 1272.070349] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 with Priority: HIGH for action security_group_rules [ 1272.070873] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 with Priority: HIGH for action security_group_rules [ 1272.070873] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 with Priority: HIGH for action security_group_rules [ 1272.070873] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 with Priority: HIGH for action security_group_rules [ 1272.070873] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGH for action security_group_rules [ 1272.070873] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521389fe-7ad3-45db-944a-1438ff593c45 with Priority: HIGH for action security_group_rules [ 1272.071489] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.071703] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.071796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.072096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.072198] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.073693] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.073826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.073887] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.074109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.074289] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.074420] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.074507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.074677] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.074790] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.074905] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.075690] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-004b1bb1-eace-4b83-88e8-7573660ca829 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.075826] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.075916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.076109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.076211] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('004b1bb1-eace-4b83-88e8-7573660ca829',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.076897] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.077155] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.077282] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84f1f591-bba8-479c-a2de-cf9524dceb77 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.077414] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.078134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.078134] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.078134] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84f1f591-bba8-479c-a2de-cf9524dceb77',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.078449] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e5e0f30-956b-4713-b190-79d66c86985e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.078588] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.078671] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.078844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.078945] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e5e0f30-956b-4713-b190-79d66c86985e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.079905] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.079905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.079994] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.080166] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.080265] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3fa85bd5-519a-4ab3-885c-dd87b56fc10a',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.080962] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-046d93ea-504a-4a85-9ee9-25113ed9b167 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.081103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.081187] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.081367] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.081474] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('046d93ea-504a-4a85-9ee9-25113ed9b167',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.082199] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bd48e89-cc58-4469-862d-723098d8ef49 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.082346] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.082555] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.082751] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.082857] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bd48e89-cc58-4469-862d-723098d8ef49',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.083562] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae697c95-678e-4288-aec7-3a6fe1dee306 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.083686] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.083774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.083946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.084072] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae697c95-678e-4288-aec7-3a6fe1dee306',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.084887] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.085043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.085141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.085344] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.085445] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('66c1d37b-c5db-46f6-a3a7-fba9859cd91e',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.086171] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.086313] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.086407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.086585] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.086705] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7fa9a372-83e3-4430-bfa3-b4320a4cc0fe',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.087410] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d87c2dce-8258-430c-b549-6c6bfe5f0943 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.087567] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.087886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.087886] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.087886] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d87c2dce-8258-430c-b549-6c6bfe5f0943',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.088694] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-df66c1e2-6914-41c1-a5ac-eb133438cab6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.088866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.088970] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.089204] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.089287] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('df66c1e2-6914-41c1-a5ac-eb133438cab6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.089989] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fab56e40-0f11-4047-a55f-7256f2c35ef8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.090180] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.090253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.090561] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.090561] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fab56e40-0f11-4047-a55f-7256f2c35ef8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.091239] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.091384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.091480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.091687] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.091799] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.092593] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.092769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.092861] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.093046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.093152] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('190b5a64-9816-4072-acb7-4bc2c9f8f4b9',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.093949] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6c2a27e-83db-4022-a129-8e3459a8cda6 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.094103] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.094211] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.094403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.094501] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6c2a27e-83db-4022-a129-8e3459a8cda6',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.095189] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.095336] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.095429] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.095608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.095712] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d6a1c404-909c-4d2a-8a7d-03a5e01c1417',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.096439] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.096575] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.096665] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.096844] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.096949] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba5bbcb7-2707-4cc4-9fe9-50838165cb90',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.097716] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.097863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.097954] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.098144] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.098248] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea613e25-cc1d-4b11-9ac5-2be1d0651607',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.098918] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.099072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.099167] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.099366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.099478] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.100154] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-521389fe-7ad3-45db-944a-1438ff593c45 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.100304] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.100438] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.100598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.100696] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('521389fe-7ad3-45db-944a-1438ff593c45',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.122849] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.123088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.123088] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.123270] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.142013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.142138] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d87c2dce-8258-430c-b549-6c6bfe5f0943 is going to be deleted. [ 1272.188264] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.188425] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.188513] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.188713] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.188803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.188915] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d87c2dce-8258-430c-b549-6c6bfe5f0943" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.608492] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.614382] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.614565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.617383] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.617578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.617938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.617938] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.618230] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.618404] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.618474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.618724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.618875] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.619051] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.619208] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.627047] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 004b1bb1-eace-4b83-88e8-7573660ca829 with status ACTIVE [ 1272.627444] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.627578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.627578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.627860] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.628027] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.628305] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.628476] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.628705] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.628848] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.628993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.629589] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.629759] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.629876] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.630141] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.630290] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.630436] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 004b1bb1-eace-4b83-88e8-7573660ca829 is going to be updated. [ 1272.633567] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.633741] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.633864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.634130] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.634376] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.634547] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.634668] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.634905] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.635062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.635222] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.635371] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.642713] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.649538] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.657582] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.657724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.657797] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.658024] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.658191] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.658293] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.658358] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.658511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.658598] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.658683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.658827] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.658918] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.658973] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.659139] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.659275] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.659384] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.659463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.659608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.659683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.659766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.659851] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.682266] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.682391] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.682460] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.682638] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.686830] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.686929] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.689390] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.689487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.690159] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.690252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.691412] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.691503] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.692186] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.692278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.692997] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.693131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.693837] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.693935] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.708558] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.708669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.710857] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.710946] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.712705] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.712806] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.713832] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.714238] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.714329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.715845] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.716252] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.716345] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.716927] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.717354] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.717452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.718025] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.718417] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.718514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.719124] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.719530] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.719602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.721548] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1272.721931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.722061] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bd48e89-cc58-4469-862d-723098d8ef49 is going to be deleted. [ 1272.722874] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.723084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.726839] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.726956] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.727043] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.727218] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.727340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.727484] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-004b1bb1-eace-4b83-88e8-7573660ca829" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.739892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.740015] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7fa9a372-83e3-4430-bfa3-b4320a4cc0fe is going to be deleted. [ 1272.740840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.741029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.756737] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.756857] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba5bbcb7-2707-4cc4-9fe9-50838165cb90 is going to be deleted. [ 1272.757622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.757809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.777215] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.777361] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.779066] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.779175] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6a1c404-909c-4d2a-8a7d-03a5e01c1417 is going to be deleted. [ 1272.779976] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.780176] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.875743] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.875895] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.895607] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.895717] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.896645] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.896768] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 66c1d37b-c5db-46f6-a3a7-fba9859cd91e is going to be deleted. [ 1272.897784] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.898013] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.966786] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.966923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.967779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.967904] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fab56e40-0f11-4047-a55f-7256f2c35ef8 is going to be deleted. [ 1272.968794] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.969007] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.066461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.066575] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 190b5a64-9816-4072-acb7-4bc2c9f8f4b9 is going to be deleted. [ 1273.067755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.068075] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.100337] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.100696] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.128158] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.128269] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: df66c1e2-6914-41c1-a5ac-eb133438cab6 is going to be deleted. [ 1273.129115] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.129378] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.146158] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.146299] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.146376] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.146579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.146669] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.146767] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1273.161280] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b2d197f8-6ecf-4737-ae78-a66d15978937: rpc.has_security_group_logging(os_id): False [ 1273.176275] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 738e5731-ace4-4b5c-98da-61384bf20f80: rpc.has_security_group_logging(os_id): False [ 1273.193827] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.194294] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.210231] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.210363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.210363] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.210564] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.210725] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.223107] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.223228] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.225888] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1273.226975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.226975] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3fa85bd5-519a-4ab3-885c-dd87b56fc10a is going to be deleted. [ 1273.227913] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.228157] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.231031] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.231160] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.234768] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.234882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.250487] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.250645] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea613e25-cc1d-4b11-9ac5-2be1d0651607 is going to be deleted. [ 1273.251544] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.251819] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.280780] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.280914] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.305337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.305548] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e5e0f30-956b-4713-b190-79d66c86985e is going to be deleted. [ 1273.306403] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.306799] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.308101] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.308197] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.328760] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.328880] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae697c95-678e-4288-aec7-3a6fe1dee306 is going to be deleted. [ 1273.329971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.329971] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.371459] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.371599] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.385286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.385372] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84f1f591-bba8-479c-a2de-cf9524dceb77 is going to be deleted. [ 1273.386159] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.386366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.387615] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.387726] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.453972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.454139] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 521389fe-7ad3-45db-944a-1438ff593c45 is going to be deleted. [ 1273.455020] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.455281] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.505077] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.505220] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d6c2a27e-83db-4022-a129-8e3459a8cda6 is going to be deleted. [ 1273.506123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.506321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.507804] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.507923] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.538722] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.538927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.554894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.555084] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 046d93ea-504a-4a85-9ee9-25113ed9b167 is going to be deleted. [ 1273.556096] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.556337] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.556451] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.556622] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bd48e89-cc58-4469-862d-723098d8ef49" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.556863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.557063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.557163] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.557385] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7fa9a372-83e3-4430-bfa3-b4320a4cc0fe" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.557889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.558124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.558280] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.558401] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba5bbcb7-2707-4cc4-9fe9-50838165cb90" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.558549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.558701] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.558781] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.558898] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6a1c404-909c-4d2a-8a7d-03a5e01c1417" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.559038] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.559199] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.559271] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.559440] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-66c1d37b-c5db-46f6-a3a7-fba9859cd91e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.559574] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.559718] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.559796] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.559945] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fab56e40-0f11-4047-a55f-7256f2c35ef8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.560091] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.560234] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.597561] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.597754] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.615399] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.615709] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.615834] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.615916] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.616123] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.616253] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.616497] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.616604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.616651] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.616817] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.616892] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.617097] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.617178] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.617242] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.617417] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.617488] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.617585] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 738e5731-ace4-4b5c-98da-61384bf20f80 is going to be updated. [ 1273.618722] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.618912] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.618993] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.619131] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-190b5a64-9816-4072-acb7-4bc2c9f8f4b9" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.619359] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.619496] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.652430] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.652604] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.653242] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.653396] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.654997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.655275] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.655366] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.655431] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.655641] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.655731] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.655827] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be updated. [ 1273.656851] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.657042] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.657154] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.657254] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3fa85bd5-519a-4ab3-885c-dd87b56fc10a" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.657407] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.657579] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.657658] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.657761] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea613e25-cc1d-4b11-9ac5-2be1d0651607" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.657907] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.658072] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.658150] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.658261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e5e0f30-956b-4713-b190-79d66c86985e" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.658380] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.658523] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.658602] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.658712] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae697c95-678e-4288-aec7-3a6fe1dee306" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.659278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.659466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.659562] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.659682] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84f1f591-bba8-479c-a2de-cf9524dceb77" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.659801] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.659972] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.660041] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.660136] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d6c2a27e-83db-4022-a129-8e3459a8cda6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.660272] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.660441] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.660519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.660639] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-df66c1e2-6914-41c1-a5ac-eb133438cab6" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.660840] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.660920] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.660975] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.661060] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-521389fe-7ad3-45db-944a-1438ff593c45" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.661188] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.661325] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.661402] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.661505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-046d93ea-504a-4a85-9ee9-25113ed9b167" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.758845] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.758979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.759067] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.759286] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.759467] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.761316] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.761433] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.761482] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.761647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.761771] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.782217] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: IN_PROGRESS for 2s [ 1273.784225] env[70287]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.784610] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 1274.849847] env[70287]: INFO networking_nsxv3.common.synchronization [req-874a3609-3ba6-490c-9081-753deb2906f9 req-224011ab-609d-49b0-9af3-4982491e3dda tempest-ServerMetadataTestJSON-595114665 tempest-ServerMetadataTestJSON-595114665-project-member] Enqueued Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_members [ 1274.850389] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 738e5731-ace4-4b5c-98da-61384bf20f80 with Priority: HIGHEST for action security_group_members [ 1274.850698] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-738e5731-ace4-4b5c-98da-61384bf20f80 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.850816] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.850882] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.851343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.851535] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.851688] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.852312] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.852537] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.852664] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.852788] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('738e5731-ace4-4b5c-98da-61384bf20f80',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.237744] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1275.237889] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.238099] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.238340] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.238538] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.238656] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.238733] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.238894] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.238978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.239069] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.239162] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.354831] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.355062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.355062] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.355332] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.355447] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.355683] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.355792] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.355864] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.356047] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.356127] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.356218] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738e5731-ace4-4b5c-98da-61384bf20f80 is going to be updated. [ 1275.388995] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.389164] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.389226] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.390109] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.390285] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.404545] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: IN_PROGRESS for 2s [ 1275.741850] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1275.794643] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: SUCCESS [ 1275.794803] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.795931] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 1275.795931] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.243139] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f: rpc.has_security_group_logging(os_id): False [ 1276.262086] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.262364] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.262504] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.262789] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.280768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.281126] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.281339] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.281423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.281709] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.281809] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.281921] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1276.346910] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.347120] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.347171] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.347416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.347620] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.358682] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1277.416079] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 738e5731-ace4-4b5c-98da-61384bf20f80 in Status: SUCCESS [ 1277.416466] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 738e5731-ace4-4b5c-98da-61384bf20f80 deletion is rescheduled due to dependency. [ 1277.416466] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-738e5731-ace4-4b5c-98da-61384bf20f80" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.373704] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1278.373997] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.374185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.374439] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.374530] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.876867] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.877250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.877250] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.877418] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.877548] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.877660] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.877711] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.877879] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.878113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.878113] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.878286] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.380436] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.851296] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1279.851438] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1279.885020] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f: rpc.has_security_group_logging(os_id): False [ 1279.904615] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.904866] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.904933] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.905284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.905452] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.905803] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.905961] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.906084] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.906343] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.906473] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.906616] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1279.980136] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.980375] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.980519] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.980833] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.981085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.995671] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1282.011549] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1282.011549] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.852897] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.853312] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1288.864738] env[70287]: INFO networking_nsxv3.common.synchronization [req-db0e8ee3-e31b-4b63-85e7-bd5dd06e4b39 req-7fb07439-f492-43a0-9c1f-2c6b2fa74e54 tempest-ServerActionsTestOtherB-625888240 tempest-ServerActionsTestOtherB-625888240-project-member] Enqueued Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1288.865279] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f with Priority: HIGHEST for action security_group_members [ 1288.865587] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.865710] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.865779] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.865968] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.866291] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.866291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.866291] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.866450] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.866507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.866602] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.369047] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.369252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.369252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.369461] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.369607] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.369812] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.369909] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.369974] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.370152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.370233] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.370321] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f is going to be updated. [ 1289.396247] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.396381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.396427] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.396578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.396706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.403775] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: IN_PROGRESS for 2s [ 1291.414348] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f in Status: SUCCESS [ 1291.414719] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f deletion is rescheduled due to dependency. [ 1291.414719] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9a9cfd1-8f5e-489c-b3e6-b81a23f85c2f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.865963] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.866331] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1298.867274] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.867682] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.705553] env[70287]: INFO networking_nsxv3.common.synchronization [req-e3f90935-0b72-432d-b14c-64e4644986c8 req-1fe5d48d-2f7c-40e6-8029-3d53b46cd259 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1303.706102] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1303.706412] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.706535] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.706608] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.707480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.707480] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.707480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.707480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.707480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.707480] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.707818] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.209766] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.712582] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.215152] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.215371] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.215423] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.215615] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.215706] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.215808] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be updated. [ 1305.245358] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.245518] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.245617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.245768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.245903] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.253950] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 1307.264874] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 1307.265210] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.707444] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1308.707714] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1310.079016] env[70287]: INFO networking_nsxv3.common.synchronization [req-e86d84ea-4c41-4755-b1e6-abbd1c8182d3 req-bcd65cf5-2cb8-4e55-b945-9e47dae9ecc6 tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_members [ 1310.079573] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15c84255-e5bf-4821-86ca-a3b374c86875 with Priority: HIGHEST for action security_group_members [ 1310.079934] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-15c84255-e5bf-4821-86ca-a3b374c86875 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.080029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.080101] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.080321] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.080755] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.080755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.080755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.080755] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.081165] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.081165] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('15c84255-e5bf-4821-86ca-a3b374c86875',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.582854] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.583036] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.583111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.583329] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.604266] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.604520] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.604635] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.604702] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.604901] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.604988] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.605091] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c84255-e5bf-4821-86ca-a3b374c86875 is going to be updated. [ 1310.628985] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.629137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.629190] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.629381] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.629990] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.637008] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c84255-e5bf-4821-86ca-a3b374c86875 in Status: IN_PROGRESS for 2s [ 1312.647674] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 15c84255-e5bf-4821-86ca-a3b374c86875 in Status: SUCCESS [ 1312.648093] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 15c84255-e5bf-4821-86ca-a3b374c86875 deletion is rescheduled due to dependency. [ 1312.648093] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-15c84255-e5bf-4821-86ca-a3b374c86875" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.662249] env[70287]: INFO networking_nsxv3.common.synchronization [None req-ffc66630-d31d-4115-bbb2-708cbc53deb1 tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_rules [ 1314.662753] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_rules [ 1314.663063] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b24540c-d3ec-4797-9ece-0ef684297b8f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.663192] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.663251] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.663505] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.663587] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.728551] env[70287]: INFO networking_nsxv3.common.synchronization [None req-728d9664-b974-4f69-93d7-7773bef9f308 tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_rules [ 1314.729056] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_rules [ 1314.729360] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b24540c-d3ec-4797-9ece-0ef684297b8f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.729463] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.185029] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.185029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.185029] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.185247] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.185310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.185404] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f already deleted. [ 1315.185486] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.185626] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.185772] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.185853] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.705111] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.705111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.705111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.705111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.705111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.705111] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f already deleted. [ 1315.705111] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.730358] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1319.730627] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1319.891830] env[70287]: INFO networking_nsxv3.common.synchronization [req-64bfc5b1-3be3-4c4a-9046-75008d32b317 req-7e67a3fc-a6f5-46bd-8fe5-581ca770c8b9 tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_members [ 1319.892336] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_members [ 1319.892646] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b24540c-d3ec-4797-9ece-0ef684297b8f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.892768] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.892837] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.893500] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.893668] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.893774] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.893855] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.894044] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.894137] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.894233] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.137037] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock network-175 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.137037] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.137037] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.137037] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.137284] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.137352] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.137448] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.137666] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.137824] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.138201] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1320.138374] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] NeedRegenerationException {{(pid=70287) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1320.138498] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] no value, waiting for create lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1320.138615] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] value creation lock acquired {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1320.138734] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] No value present for key: 'zone-id' {{(pid=70287) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:915}} [ 1320.138879] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Calling creation function for not-yet-present value {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1320.138987] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1320.159505] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1320.159662] env[70287]: DEBUG dogpile.cache.region [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=70287) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:907}} [ 1320.159803] env[70287]: DEBUG dogpile.lock [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Released creation lock {{(pid=70287) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1320.160014] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "network-175" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.160302] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock port-29e33318-0094-4f95-9e06-ef2757c384d8 taken with stack trace [, , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.160468] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.160589] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.160875] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.161024] env[70287]: DEBUG networking_nsxv3.api.rpc [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e33318-0094-4f95-9e06-ef2757c384d8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.396061] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.396278] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.396355] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.396578] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.396670] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.396880] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.396979] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.397058] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.397215] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.397292] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.397378] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f already deleted. [ 1320.397458] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.663218] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.663420] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.663552] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.663906] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.664094] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.664263] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Segment Port 29e33318-0094-4f95-9e06-ef2757c384d8 not found, creating... [ 1320.664545] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.664712] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.664835] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.665078] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.665227] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.665552] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.665716] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.665840] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.666068] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.666215] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.666359] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Resource: SegmentPort with ID: 29e33318-0094-4f95-9e06-ef2757c384d8 is going to be created. [ 1320.684181] env[70287]: DEBUG networking_nsxv3.common.locking [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.684371] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.684498] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.684736] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.684961] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.685206] env[70287]: DEBUG oslo_concurrency.lockutils [None req-67c8db8a-e75f-4755-b26a-79af38147279 None None] Releasing lock "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.346999] env[70287]: INFO networking_nsxv3.common.synchronization [req-64bfc5b1-3be3-4c4a-9046-75008d32b317 req-4181b778-3fae-4d48-9533-4809d6d8e7eb service nova] Enqueued Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_rules [ 1321.347275] env[70287]: INFO networking_nsxv3.common.synchronization [req-64bfc5b1-3be3-4c4a-9046-75008d32b317 req-4181b778-3fae-4d48-9533-4809d6d8e7eb service nova] Enqueued Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_members [ 1321.347478] env[70287]: INFO networking_nsxv3.common.synchronization [req-64bfc5b1-3be3-4c4a-9046-75008d32b317 req-4181b778-3fae-4d48-9533-4809d6d8e7eb service nova] Enqueued Resource ID: 29e33318-0094-4f95-9e06-ef2757c384d8 with Priority: HIGHEST for action port [ 1321.347555] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_rules [ 1321.347687] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_members [ 1321.347784] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e33318-0094-4f95-9e06-ef2757c384d8 with Priority: HIGHEST for action port [ 1321.348342] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b24540c-d3ec-4797-9ece-0ef684297b8f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.348471] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.348554] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.348831] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.348917] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.349789] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b24540c-d3ec-4797-9ece-0ef684297b8f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.349885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.349977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.350174] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.350321] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.350416] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.350474] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.350617] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.350699] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.350787] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.356606] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock port-29e33318-0094-4f95-9e06-ef2757c384d8 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.356606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.356606] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.356863] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.356863] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e33318-0094-4f95-9e06-ef2757c384d8',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.520500] env[70287]: INFO networking_nsxv3.common.synchronization [req-806c215c-360e-4cf7-87df-4cbd37b3b91b req-62d163d7-dc6c-4350-b1db-4252f11680b7 tempest-ServerActionsTestOtherA-1132868678 tempest-ServerActionsTestOtherA-1132868678-project-member] Enqueued Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1321.521086] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2d197f8-6ecf-4737-ae78-a66d15978937 with Priority: HIGHEST for action security_group_members [ 1321.521393] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-b2d197f8-6ecf-4737-ae78-a66d15978937 taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.521508] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.521576] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.521769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.521917] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.522030] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.522095] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.522246] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.522331] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.522425] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b2d197f8-6ecf-4737-ae78-a66d15978937',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.858566] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1321.859317] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b24540c-d3ec-4797-9ece-0ef684297b8f taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.859444] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.860475] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 29e33318-0094-4f95-9e06-ef2757c384d8 with status ACTIVE [ 1321.860475] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.860475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.860475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.860475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.860475] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.860753] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.860753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.860753] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.860850] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.860942] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.861159] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.861302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.861302] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.861446] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.861552] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.861595] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 29e33318-0094-4f95-9e06-ef2757c384d8 is going to be updated. [ 1321.884978] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.885124] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.885193] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.885377] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.885502] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.885654] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29e33318-0094-4f95-9e06-ef2757c384d8" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.025196] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.025368] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.025410] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.025593] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.025683] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.025878] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.025977] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.026054] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.026207] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.026283] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.026400] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 is going to be updated. [ 1322.072112] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.072261] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.072328] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.072514] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.072647] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.080791] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: IN_PROGRESS for 2s [ 1322.361051] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.864046] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.864046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.864046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.864046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.864046] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.864046] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f is going to be created. [ 1322.884573] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.884732] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.884769] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.884924] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.885085] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.892934] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f in Status: UNINITIALIZED for 2s [ 1324.089886] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b2d197f8-6ecf-4737-ae78-a66d15978937 in Status: SUCCESS [ 1324.090195] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b2d197f8-6ecf-4737-ae78-a66d15978937 deletion is rescheduled due to dependency. [ 1324.090252] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b2d197f8-6ecf-4737-ae78-a66d15978937" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.901589] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f in Status: SUCCESS [ 1324.901788] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.901947] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.902185] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.902394] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.902511] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.902572] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.902730] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.902815] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.902899] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.902986] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.405580] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.907868] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b24540c-d3ec-4797-9ece-0ef684297b8f: rpc.has_security_group_logging(os_id): False [ 1325.925073] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.925219] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.925297] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.925507] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.925595] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.925828] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.925927] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.925991] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.926152] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.926230] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.926318] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f is going to be created. [ 1325.982131] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.982301] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.982382] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.982591] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.982766] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.993200] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f in Status: IN_PROGRESS for 2s [ 1326.522690] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1326.522953] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1328.005896] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f in Status: SUCCESS [ 1328.006284] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.523900] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1331.524257] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1336.524950] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1336.525329] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1341.525947] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1341.526332] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1346.527463] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1346.527775] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1351.528687] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1351.529093] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1356.529565] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1356.529915] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.530920] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1361.531225] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1366.532537] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1366.532911] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1371.533707] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1371.534133] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1376.535350] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1376.535669] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1381.536190] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1381.536657] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1386.537473] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1386.537787] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.538748] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1391.539195] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1396.540429] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1396.540876] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.140405] env[70287]: INFO networking_nsxv3.common.synchronization [req-19805214-9561-47fa-aac5-d21cdfbf5b99 req-dd617716-99df-4e28-b370-f1d84adadc6d tempest-AttachVolumeTestJSON-249359200 tempest-AttachVolumeTestJSON-249359200-project-member] Enqueued Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_members [ 1398.140964] env[70287]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f with Priority: HIGHEST for action security_group_members [ 1398.141623] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b24540c-d3ec-4797-9ece-0ef684297b8f taken with stack trace [, , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.141623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.141623] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.141847] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.141847] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.142063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.142063] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.142153] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.142200] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.142292] env[70287]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b24540c-d3ec-4797-9ece-0ef684297b8f',) {} {{(pid=70287) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1398.645192] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.645369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.645369] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.645581] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.645679] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.645877] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.645978] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.646052] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.646208] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.646282] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.646373] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f is going to be updated. [ 1398.680405] env[70287]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=70287) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.680565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.680565] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.680724] env[70287]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.680885] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.688544] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f in Status: IN_PROGRESS for 2s [ 1400.699797] env[70287]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f in Status: SUCCESS [ 1400.700310] env[70287]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b24540c-d3ec-4797-9ece-0ef684297b8f deletion is rescheduled due to dependency. [ 1400.700310] env[70287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b24540c-d3ec-4797-9ece-0ef684297b8f" {{(pid=70287) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.141774] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.142169] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.143561] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.143935] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.144539] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.144873] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.145285] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.145636] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.146771] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.147101] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.147833] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.148181] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.149350] env[70287]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.149751] env[70287]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0